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Abstract 

We study automorphisms of a relatively hyperbolic group G. When G is one- 
ended, we describe Out(G) using a preferred JSJ tree over subgroups that are virtually 
cyclic or parabolic. In particular, when G is toral relatively hyperbolic, Out(G) is 
virtually built out of mapping class groups and subgroups of GL n (Z) fixing certain 
basis elements. When more general parabolic groups are allowed, these subgroups of 
GL n {X) have to be replaced by McCool groups: automorphisms of parabolic groups 
acting trivially (i.e. by conjugation) on certain subgroups. 

Given a malnormal quasiconvex subgroup P of a hyperbolic group G, we view G 
as hyperbolic relative to P and we apply the previous analysis to describe the group 
Out(P / G) of automorphisms of P that extend to G: it is virtually a McCool group. If 
Out(P / G) is infinite, then P is a vertex group in a splitting of G. If P is torsion-free, 
then Out(P / G) is of type VF, in particular finitely presented. 

We also determine when Out(G) is infinite, for G relatively hyperbolic. The inter- 
esting case is when G is infinitely-ended and has torsion. When G is hyperbolic, we 
show that Out(G) is infinite if and only if G splits over a maximal virtually cyclic sub- 
group with infinite center. In general we show that infinitcncss of Out(G) comes from 
the existence of a splitting with infinitely many twists, or having a vertex group that 
is maximal parabolic with infinitely many automorphisms acting trivially on incident 
edge groups. 

1 Introduction 

This paper studies automorphisms of hyperbolic and relatively hyperbolic groups in re- 
lation with their splittings. The first result in this direction is due to Paulin |Pau91| : if 
G is a hyperbolic group with Out(G) infinite, then G has an action on an M-tree with 
virtually cyclic (possibly finite) arc stabilizers. Rips theory then implies that G splits over 
a virtually cyclic group. 

Understanding the global structure of Out(G) requires techniques which depend on the 
number of ends of G. If G is one-ended, there is an Out(G)-invariant JSJ decomposition, 
and its study leads to Sela's description of Out(G) as a virtual extension of a direct product 
of mapping class groups by a virtually abelian group [Sel971lL~ev05aj . If G has infinitely 
many ends, one does not get such a precise description because there is no Out(G)-invariant 
splitting. One may study Out(G) by letting it act on a suitable space of splittings, the 
most famous being Culler- Vogtmann's outer space for Out(F n ). 

Before moving on to relatively hyperbolic groups, here is a basic problem about which 
we get new results in the context of hyperbolic, and even free, groups. Given a finitely 
generated subgroup P of a group G, consider the group Out(P/G) C Out(P) consisting 
of outer automorphisms of P which extend to automorphisms of G. What can one say 
about this group ? For instance, is it finitely generated? finitely presented? This question 
was asked by D. Calegari for automorphisms of free groups, and we answer it when P is 
malnormal. 

The answer is related to splittings through the following simple remark: if P is a vertex 
group in a splitting of G, say G = A *c± P *C2 then any automorphism of P which 



acts trivially (i.e. as conjugation by some element pi G P) on each incident edge group Ci, 
extends to G (this is the algebraic translation of the fact that any self-homeomorphism of 
a closed subset Y C X which is the identity on the frontier of Y extends by the identity 
to a homeomorphism of X). 

The following theorem says that this phenomenon accounts for almost all of Out(P / G). 

Theorem 1.1 (see Corollary 16. 3p . Let P be a quasiconvex malnormal subgroup of a hy- 
perbolic group G. If Out(P f G) is infinite, then P is a vertex group in a splitting of G, 
and the group of outer automorphisms of P acting trivially on incident edge groups has 
finite index in Out(P f G). 

We call the group of outer automorphisms of P acting trivially on a family of sub- 
groups a McCool group of P, because of McCool's paper about subgroups of Out(F n ) 
fixing a finite set of conjugacy classes |McC75j . In this language, Theorem 11.11 savs that 
Out(P / G) is virtually a McCool group of P. It is a theme of this paper that many groups 
of automorphisms may be understood in terms of McCool groups, and that many results 
concerning the full group Out(G) also apply to McCool groups (see also |GL| ). 

The groups considered by McCool are finitely presented [McC75j. In fact, they have 
a finite index subgroup with a finite classifying space [CV86] . In |GL| we extend these 
results to all McCool groups of torsion-free hyperbolic groups (and more generally of toral 
relatively hyperbolic groups). From this, one deduces that Out(P I G) has a finite index 
subgroup with a finite classifying space when G and P are as in Theorem II. 1\ with G 
torsion-free. 

Our hypotheses for Theorem 1 namely quasiconvexity and malnormality of P, imply 
that G is hyperbolic relative to P (see [Bow99j). In fact, Theorem 11.11 is just a special 
case of a result describing Out(P / G) as a virtual McCool group when G is relatively hy- 
perbolic and P is a maximal parabolic subgroup (see Theorem 16.21 for a precise statement). 

This paper also addresses the question of whether Out(G) is finite or infinite. It turns 
out that the answer is much simpler when G is torsion- free, owing to the fact that Out(G) 
is then infinite whenever G has infinitely many ends (see Lemma l7.ip . 

Things are more complicated when torsion is allowed. For instance, characterizing 
virtually free groups with Out(G) infinite is a non-trivial problem which was solved by 
Pettet |Pet97j . The following theorem gives a different characterization. We say that a 
subgroup of G is 2 mgji if it is maximal for inclusion among virtually cyclic subgroups with 
infinite center. 

Theorem 1.2 (see Theorems 17. 141 and 17. 15f) . Let G be a hyperbolic group. Then Out(G) 
is infinite if and only G splits over a Z mSuX subgroup C; in this case, any element c E C of 
infinite order defines a Dehn twist which has infinite order in Out(G). 

Moreover, one may decide algorithmically whether Out(G) is finite or infinite. 

The first assertion answers a question asked by D. Groves. See jCarllj for a related 
result proved independently by M. Carette, and |Lev0 5a, DGlT] for the one-ended case. 

Let us now consider (in)finiteness of Out(G) when G is relatively hyperbolic. Suppose 
that G is hyperbolic with respect to a finite family V of finitely generated subgroups P{. 
Since automorphisms of G need not respect V (for instance, G may be free and V may 
consist of any finitely generated malnormal subgroup), we consider the group Out(G;P) 
consisting of automorphisms mapping each Pj to a conjugate (in an arbitrary way). Note 
that Out(G; V) has finite index in the full group Out(G) when the groups Pj are small but 
not virtually cyclic, more generally when they are not themselves relatively hyperbolic in 
a nontrivial way |MO| . 

Given a splitting of G, we have already pointed out that any automorphism of a vertex 
group acting trivially on incident edge groups extends to an automorphism of G. Twists 



2 



around edges of the splitting also provide automorphisms of G. For instance, if G = A*cB, 
and a £ A centralizes C, there is an automorphism of G equal to conjugation by a on A 
and to the identity on B. Note that we do not require that C be virtually cyclic or that 
a E C (see Subsection 12. 6p . 

The following result says that infiniteness of Out(G; V) comes from twists or from a 
McCool group of a parabolic group. 

Theorem 1.3 (see Corollarv l7.13|) . Let G be hyperbolic relative to a family V = {Pi, . . . , P n } 
of finitely generated subgroups. Then Out(G;V) is infinite if and only if G has a splitting 
over virtually cyclic or parabolic subgroups, with each Pi contained in a conjugate of a 
vertex group, such that one of the following holds: 

• the group of twists of the splitting is infinite; 

• some Pi is a vertex group and there are infinitely many outer automorphisms of Pi 
acting trivially on incident edge groups. 

As mentioned above, one can get similar results characterizing the infiniteness of Mc- 
Cool groups of G. We refer to Section in particular Theorem 17.61 and Corollary 17.131 
for more detailed statements. 

Let us now discuss the techniques that we use. We assume that G is hyperbolic 
relative to V ', and we distinguish two cases according to the number of ends (technically, 
we consider relative one-endedness, but we will ignore this in the introduction). 

When G is one-ended, we use a canonical Out(G; ^-invariant decomposition r can of 
G, namely (see Subsection 13. 3p the JSJ decomposition over elementary (i.e. parabolic or 
virtually cyclic) subgroups relative to parabolic subgroups (i.e. parabolic subgroups have 
to be contained in conjugates of vertex groups). 

One may thus generalize the description of Out(G) given by Sela for G hyperbolic, and 
express Out(G; V) in terms of mapping class groups, McCool groups of maximal parabolic 
subgroups, and a group of twists T ■ For simplicity we restrict to a special case here (see 
Section U] for a general statement). 

Theorem 1.4 (see Corollary 14. SJ) . Let G be toral relatively hyperbolic and one-ended. 
Then some finite index subgroup Out 1 (G) o/Out(G) fits in an exact sequence 

p m 

1 -> T -»• Out^G) -»• jjMCG°(Si) x Yl GL r ^ nk (%) -»• 1 

8=1 fc=l 

where T is finitely generated free abelian, MCG°(Sj) is the group of isotopy classes of 
homeomorphisms of a compact surface E$ mapping each boundary component to itself in 
an orientation-preserving way, and GL r ^ n (Z) is the group of automorphisms of Z r+n fixing 
the first n generators. 

More generally, McCool groups of a one-ended toral relatively hyperbolic group G have 
a similar description (see Corollary 14. 9|) . A more general statement (without restriction 
on the parabolic subgroups) is given in Theorems 14.31 and 14.61 

We also show that the modular group of G, introduced by Sela [Sel99, Sel01j and usually 
defined by considering all suitable splittings of G, may be seen on the single splitting r can . 
We refer to Section [5] for details. 

To prove Theorem 11.11 when G is one-ended, one applies the previous analysis, viewing 
G as hyperbolic relative to P. Note that we use a JSJ decomposition which is relative (to 
P), and over subgroups which are not small (any subgroup of P is allowed). 

Another example of the usefulness of relative JSJ decompositions is to prove the Scott 
conjecture about fixed subgroups of automorphisms of free groups. The proof that we give 
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in Sectional though not really new, is simplified by the use of the cyclic JSJ decomposition 
relative to the fixed subgroup. 

We therefore work consistently in a relative context. We fix another family of finitely 
generated subgroups H = {Hx,...,H q }, and we define Out(G; V, U {t) ) as the group of 
automorphisms mapping Pj to a conjugate (in an arbitrary way) and acting trivially on 
Hj (i.e. as conjugation by an element gj of G). 

In order to understand the structure of the automorphism group of a one-ended rela- 
tively hyperbolic group from its canonical JSJ decomposition, one needs to control auto- 
morphisms of rigid vertex groups. This is made possible by the following generalisation of 
Paulin's theorem mentioned above: 

Theorem 1.5 (see Theorem 13. 9p . Let G be hyperbolic relative to V = {Pi, ■ ■ ■ ,P n }, with 
Pi finitely generated and Pi ^ G. Let % = {H±, . . . , H q } be another family of finitely 
generated subgroups. 

Lf Out(G; V, H^) is infinite, then G splits over an elementary (virtually cyclic or 
parabolic) subgroup relative to VL)7i. 

Note that there is no quasiconvexity or malnormality assumption on groups in T~L, but 
the automorphisms that we consider have to act trivially on them (see also Remark I9.3|) . 

The theorem is proved using the Bestvina-Paulin method (extended to relatively hy- 
perbolic groups in |BS08j ) to get an action on an E-tree T, and then applying Rips theory 
as developed in [BF95] to get a splitting. There are technical difficulties in the second 
step because G may fail to be finitely presented (the Pi's are not required to be finitely 
presented), and the action on T may fail to be stable if the Pi's are not slender; it only 
satisfies a weaker property which we call hypo stability, and in the last section we generalize 
[BF95] to hypostable actions of relatively finitely presented groups. 

Theorem 11.51 explains why McCool groups appear in Theorems 11.31 and 11.41 Indeed, 
given a rigid vertex group G v in a JSJ decomposition of a one-ended group, Theorem 11.51 
implies that only finitely many outer automorphisms of G v extend to automorphisms of 
G. In turn, this implies that, after passing to a finite index subgroup, automorphisms of 
G act trivially on edge groups of the JSJ decomposition. See Subsection 14.11 for details. 

When G is not one-ended, one has to consider splittings over finite groups. We do 
not have an exact sequence as in Theorem 11.41 because there is no Out(G; ^-invariant 
splitting. In order to prove Theorems 11.21 and II. 3( we use the tree of cylinders introduced 
in |GLllj to obtain a non-trivial splitting over finite groups which is invariant or has an 
infinite group of twists (Corollary 17. lip . 

The paper is organized as follows. Section [2] consists of preliminaries (JSJ decomposi- 
tions, automorphisms of a tree, trees of cylinders). Section [3] contains generalities about 
relatively hyperbolic groups. We point out that vertex groups of a splitting over relatively 
quasiconvex subgroups are relatively quasiconvex, and that the canonical JSJ decomposi- 
tion r can has finitely generated edge groups. In Section H] we study the structure of the 
automorphism group of a one-ended relatively hyperbolic group. Section [5] is devoted to 
the modular group. In Section Owe study extendable automorphisms; Theorem 11.11 is a 
special case of Theorem 16.21 Section [7] is devoted to the question of whether groups like 
Out(G;P,^W) and Out(G;V® ,H®) are finite or infinite. Section [S] contains a proof of 
the Scott conjecture, and a partial generalization to relatively hyperbolic groups. Theorem 
11.51 is proved in Section [9l 
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2 Preliminaries 

Unless mentioned otherwise, G will always be a finitely generated group. 

Given a group A and a subgroup B, we denote by Z(A) the center of A, by Za{B) the 
centralizer of B in A, and by Na(B) the normalizer of B in A. We write B 9 for gBg . 

A subgroup B C A is malnormal if P 9 D P is trivial for all 5 ^ B, almost malnormal 
if £3 n B is finite for all g £ B. 

A group is virtually cyclic if it has a cyclic subgroup of finite index; it may be finite 
or infinite. Its outer automorphism group is finite. 

A group G is slender if G and all its subgroups are finitely generated. We say that G is 
small if it contains no non-abelian free group (see [BF91j for a slightly weaker definition). 

Let V be a family of subgroups Pj. In most cases, V will be a finite collection of finitely 
generated groups V = {Pi, . . . ,P n }. 

The group G is finitely presented relative to V = {Pi, . . . , P n } if it is the quotient of 
Pi * ■ ■ ■ * P n * F by the normal closure of a finite subset, with F a finitely generated free 
group. If G is finitely presented relative to V = {Pi, . . . , P n }, and if g\, ... ,g n 6 G, then 
G is also finitely presented relative to {Pf 1 , . . . , Pn}- 

Let P be a finitely generated subgroup. If G is finitely presented relative to V, then 
G is finitely presented relative to V U {H}; the converse is not true in general. 

2.1 Relative automorphisms 

Given G and P, we denote by Aut(G;P) the subgroup of Aut(G) consisting of auto- 
morphisms mapping each Pj to a conjugate, and by Out(G;P) its image in Out(G). If 
V = {Pi, . . . , P n }, we use the notations Aut(G; Pi, ... , P n ) and Out(G; Pi, ... , P n ). We 
also write Out(G;P, Q) for Out(G;P U Q). 

We define Out(G; V^) C Out(G; V) by restricting to automorphisms whose restriction 
to each Pj agrees with conjugation by some element gi of G (we call them marked auto- 
morphisms, or automorphisms acting trivially on V). An outer automorphism <1> belongs 
to Out(G;PW) if and only if, for each i, it has a representative on 6 Aut(G) equal to the 
identity on Pj. 

The group Out(G;pM) i s denoted by PMCG in |Lev05a| . by Out m (G;P) in |DG11| . 
and is called a (generalized) McCool group in [GLJ. 
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Note that Out(G; G®) is trivial, and that Out(G;P( t )) has finite index in Out(G;V) 
if V is a finite collection of finite groups (more generally, of groups P with Out(P) finite). 

If H = {H\, . . . , H q } is another family of subgroups, we define Out(G; V, % {t) ) = 
Out(G;"P) n Out(G;?{ (t) ). We allow V or U to be empty, in which case we do not write 
it. 

The groups defined above do not change if we replace each Pj or Hj by a conjugate, 
or if we add conjugates of the Pj's to V or conjugates of the Hj's to ~K. 

2.2 Splittings 

A splitting of a group G is an isomorphism between G and the fundamental group of a 
graph of groups T. Equivalently, using Bass-Serre theory, we view a splitting of G as 
an action of G on a simplicial tree T, with T/G = T. This tree is well-defined up to 
equivariant isomorphism, and two splittings are considered equal if there is an equivariant 
isomorphism between the corresponding Bass-Serre trees. 

The group Out(G) acts on the set of splittings of G (by changing the isomorphism 
between G and 7Ti(r), or precomposing the action on T). 

Trees will always be simplicial trees with an action of G without inversion. We usually 
assume that the splitting is minimal (there is no proper G-invariant subtree). Since G is 
assumed to be finitely generated, this implies that T is a finite graph. 

A splitting is trivial if G fixes a point in T (minimality then implies that T is a point). 

A splitting is relative to V if every Pj is conjugate to a subgroup of a vertex group, or 
equivalently if Pi is elliptic (i.e. fixes a point) in T. If V = {Pi, ■ ■ ■ , P n }, we also say that 
the splitting is relative to P\, . . . ,P n . 

The group G splits over a subgroup A (relative to V) if there is a non-trivial minimal 
splitting (relative to V) such that A is an edge group. The group is one-ended relative to 
V if it does not split over a finite group relative to V. 

If T is a graph of groups, we denote by V its set of vertices, and by E its set of oriented 
edges. The origin of an edge e € E is denoted by o(e). A vertex v or an edge e carries a 
group G v or G e , and there is an inclusion i e : G e — > G ( e ) 

2.3 Trees and deformation spaces |For02|lGL07a| 

In this subsection we consider trees rather than graphs of groups. We denote by G v or G e 
the stabilizer of a vertex or an edge. 

We often restrict edge stabilizers of T by requiring that they belong to a family A of 
subgroups of G which is stable under taking subgroups and under conjugation. We then 
say that T is an A-tree. For instance, A may be the set of finite subgroups, of cyclic 
subgroups, of abelian subgroups, of elementary subgroups of a relatively hyperbolic group 
(see Section [3D. We then speak of cyclic, abelian, elementary trees (or splittings). 

Besides restricting edge stabilizers, we also often restrict to trees T relative to V: every 
Pi is elliptic in T. We then say that T is an (A, V) -tree. 

A tree T' is a collapse of T if it is obtained from T by collapsing each edge in a certain 
G-invariant collection to a point; conversely, we say that T refines T' . In terms of graphs 
of groups, one passes from T = T/G to V = T' /G by collapsing edges; for each vertex 
»' £ T', the vertex group G v i is the fundamental group of the graph of groups occuring as 
the preimage of v' in V. 

Given two trees T and T", we say that T dominates T' if there is a G-equivariant map 
/ : T — > T' , or equivalently if every subgroup which is elliptic in T is also elliptic in T' . In 
particular, T dominates any collapse T". 

Two trees belong to the same deformation space if they dominate each other. In other 
words, a deformation space T> is the set of all trees having a given family of subgroups as 
their elliptic subgroups. We denote by T>(T) the deformation space containing a tree T, 
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and by Out(D) C Out(G) the group of automorphisms leaving T> invariant. The set of 
yi-trees contained in a deformation space is called a deformation space over A (and usually 
denoted by V also) . 

A tree is reduced if G e ^ G v , G w whenever an edge e has its endpoints n,to in different 
G-orbits. Equivalently, no tree obtained from T by collapsing the orbit of an edge belongs 
to the same deformation space as T. If T is not reduced, one may collapse edges so as to 
obtain a reduced tree in the same deformation space. 

Any two reduced trees in a deformation space over finite groups may be joined by slide 
moves (see [For02 , GL07a | for definitions). In particular, they have the same set of edge 
and vertex stabilizers. 

2.4 Induced structures 

Definition 2.1 (Incident edge groups Inc tI ). Given a vertex v of a graph of groups T, we 
denote by lnc v the collection of all subgroups i e {G e ) of G v , for e an edge with origin v. 
We call Inc v the set of incident edge groups. We also use the notation Incg^. 

Similarly, if v is a vertex of a (minimal) tree, there are finitely many G^-orbits of 
incident edges, and Inc„ is the family of stabilizers of some representatives of these orbits. 
This is a finite collection of subgroups of G v , each well-defined up to conjugacy. 

Any splitting r„ of G v relative to Inc„ extends (non-uniquely) to a splitting A of G, 
whose edges are those of T v together with those of T. We call this refining F at v using 
IV One recovers T from A by collapsing edges of T v . 

Lemma 2.2. Consider subgroups H C K C G such that, if g £ G and H 9 C K, then 
g € K (this holds in particular when K is a vertex stabilizer of a tree T, and H is a 
subgroup which fixes no edge ofT). 

• If H' C K is conjugate to H in G, it is conjugate to H in K. 

• If a £ Aut(G) leaves K invariant and maps H to gHg^ 1 , then g € K. □ 

This lemma is trivial, but very useful. Given a vertex stabilizer G v of a tree T, it 
allows us to define a family V\q v as follows (like Inct,, it is a finite set of subgroups of G v , 
each well-defined up to conjugacy). 

Definition 2.3 (Induced structure V\q v ). Let V = {Pi} be a collection of subgroups of 
G, and let G v be a vertex stabilizer in a tree T relative to V . For each i such that Pi 
fixes a point in the orbit of v, but fixes no edge of T , let Pi C G v be a conjugate of Pi. 
When defined, Pi is unique up to conjugacy in G v by Lemma \2.2[ We define V\g v as 
this collection of subgroups Pi C G v ; we define V\q v similarly if G v is a vertex group of 
T = T/G. 

Remark 2.4. Given v and i, one of the following always holds: Pi fixes a vertex of T not in 
the orbit of v, or some conjugate of Pi fixes v and an edge incident to v, or Pi is conjugate 
to a group in V\g v ■ 

Remark 2.5. In this definition, V\g v depends not only on V and G v , but also on the 
incident edge groups of G v . In practice, we will not work with V\q v alone, but with 
Qv = 'PiGv U InCu. This is the case for instance in the following lemma. 

Lemma 2.6. IfT v is a splitting of G v relative to Q v = Inc v WP\q v , refining T at v using 
T v yields a splitting A of G which is relative to V . 

Proof. The refinement is possible because T v is relative to Inc„. Each Pi is elliptic in A 
by Remark [231 □ 
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2.5 JSJ decompositions |GL09j 



Fix A as in Subsection 12.31 and a (possibly empty) family V of subgroups. All trees 
considered here are (A, 7 3 )-trees. 

A subgroup H is universally elliptic if it is elliptic (fixes a point) in every tree. A 
tree is universally elliptic if its edge stabilizers are. A tree T is a JSJ tree over A relative 
to V if it is universally elliptic and dominates every universally elliptic tree (sec [GL09J). 
JSJ trees exist if G is finitely presented relative to V. The set of JSJ trees, if non-empty, 
is a deformation space called the JSJ deformation space over A relative to V . When 
A is the set of cyclic (abelian, elementary...) subgroups, we refer to the cyclic (abelian, 
elementary...) JSJ. 

When A is the set of finite subgroups, and V = 0, the JSJ deformation space is 
the Stallings-Dunwoody deformation space, characterized by the property that its trees 
have vertex stabilizers with at most one end. Because it is a deformation space over finite 
groups, all its reduced trees have the same edge and vertex stabilizers (see Subsection l2.3p . 
This space exists if and only if G is accessible, in particular when G is finitely presented 
[Dun85 . If G is torsion-free, the Stallings-Dunwoody deformation space is the Grushko 
deformation space; edge stabilizers are trivial, vertex stabilizers are freely indecomposable 
and non-cyclic. 

More generally, the JSJ deformation space over finite subgroups relative to V will be 
called the Stallings-Dunwoody deformation space relative to V . It exists when G is finitely 
presented relative to V (see [GL09J). We will also consider JSJ spaces over finite subgroups 
of cardinality bounded by some k; these exist whenever G is finitely generated by LinnelPs 
accessibility [L~in83j . 

If T is a tree (in particular, if it is a JSJ tree), a vertex stabilizer G v of T not belonging 
to A (or v itself) is rigid if it is universally elliptic. Otherwise, G v (or v) is flexible. In many 
situations, flexible vertex stabilizers G v of JSJ trees are quadratically hanging subgroups. 

Definition 2.7 (QH vertex). A vertex stabilizer G v (or v) is quadratically hanging, or 
QH, (relative toV) if there is a normal subgroup F <\ G v (called the fiber of G v ) such that 
G v /F is isomorphic to the fundamental group 7i"i(S) of a hyperbolic 2-orbifold E (usually 
with boundary); moreover, if H C G v is an incident edge stabilizer, or is the intersection 
of G v with a conjugate of a group in V , then the image of H in 7Ti(£) is finite or contained 
in a boundary subgroup (a subgroup conjugate to the fundamental group of a boundary 
component). 

Definition 2.8 (Full boundary subgroups). Let G v be a QH vertex stabilizer. For each 
boundary component of T,, we select a representative for the conjugacy class of its fun- 
damental group in 7Ti(£), and we consider its full preimage in G v . This defines a finite 
family B v of subgroups of G v . 

If G v is QH with finite fiber, every infinite incident edge stabilizer is virtually cyclic 
and (up to conjugacy in G v ) contained with finite index in a group of B v . If G is one-ended 
relative to V, then every incident edge stabilizer is infinite, so is contained in a group of 
B v . 

Remark 2.9. If G v is a flexible QH vertex stabilizer with finite fiber, and H CZ G v is 
universally elliptic, then the image of H in 7Ti(E) is finite or contained in a boundary 
subgroup (see Proposition 7.6 of [GL09J; this requires a technical assumption on A, which 
holds in all cases considered in the present paper). In particular, H is virtually cyclic. 

2.6 The automorphism group of a tree |Lev05a] 

Let T be a tree with a minimal action of G. We denote by Aut(T) C Aut(G) the group 
of automorphisms a leaving T invariant: there exists an isomorphism f a : T — > T which 
is a-equivariant in the sense that f a (gx) = a(g)f a (x) for g £ G and x G T. 
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Following |Lev05a| . we describe the image Out(T) of Aut(T) in Out(G) in terms of 
the graph of groups T = T/G. 

The group Out(T) acts on the finite graph T = T/G, and we define Out°(T) as the 
finite index subgroup acting trivially. We use the notations Out(T; V, H^) = Out(T) n 
Out{G;V,U^), and Out°(T; P,H®) = Out°(T) n Out(G;P,H®) (see Section EE) . 



Action on vertex groups. If v G V is a vertex of T, there is a natural map p v : 
Out°(T) ->• Out(G„) defined as follows. Let $ G Out°(T). When N G (G V ) acts on G v 
by inner automorphisms, in particular when G v fixes a unique point in T (in this case 
Nc(G v ) = G v ), one defines p v ($>) simply by choosing any representative a G Aut(T) of $ 
leaving G v invariant and considering its restriction to G v . In general, one has to choose a 
more carefully: one fixes a vertex v of T mapping to v such that the stabilizer of v is G v , 
one chooses a so that f a fixes v, and p v ($) is represented by the restriction a\Q v . 

If e is an edge of T, one may define p e : Out°(T) — > Out(G e ) similarly. 

Let p : Out°(T) -> n„ e y Out(G„) be the product map. As pointed out in |Lev05a] . the 

image p(Out°(T)) contains n«ev Out(G„;Inc^ ) and is contained in n^ey Out(G v ; Inc„). 
More precisely: 

Lemma 2.10. Let V,H be two families of subgroups of G. Let T be a tree relative to 
VUV.. Then 

Out(G v ihx$\V\G v ,n\$ v ) C p v (Out°(T;P,H®)) C Out(G v ;Inc u ,P| G , j) ^fgj (1) 
for every v G V , and 

H Ont(G v ;ln4\V\ Gv ,n\2j C p(Out°(T;P,n^)) C [] Out(G v ;lnc v ,V\ Gv ,n^ v ). 

Lf Out(G e ) is finite for all edges (resp. for all edges e incident to v), all inclusions 
(resp. all inclusions in ^) have images of finite index. 



Recall that P\g v was defined in Definition 127 

Proof. The inclusion Jl^ey Out(G v ;Inc| . ) C p(Out°(T)) is proved in |Lev05aj by extend- 
ing any G Out(G„; Inci^) "by the identity" to get $ G Out°(T), with = p v ($), 
acting as a conjugation on each edge group and on each G w for w ^ v. The left hand side 
inclusions in the lemma follow from Remark 12.41 

The inclusion p v (Out°(T)) C Out(G v ;Inc„) follows from the fact that, given an edge 
e of T containing the lift v of v used to define p v , any <3? G Out°(T) has a representative 
a such that f a fixes e; this representative induces an automorphism of Gv leaving G e 
invariant. To prove the right hand side inclusions, apply Lemma 12.21 with K = G v , 
recalling that groups in %\g v or P\g v fi x a unique point in T. 

If Out(G e ) is finite for all incident edge groups, Out(G v ; Inc„ ) has finite index in 
Out(G„;Inc„) (see Proposition 2.3 in |Lev05a| ). Intersecting with Out(G v ; V\q v , ), 

we get that Out(Gr v ;Inc£ ,P\g v :^\g ) ^ as ^ n ^e index in Ont(G v ; Inc v , P\g v > "hIq )• This 
conludes the proof. □ 

Remark 2.11. We can also consider automorphisms which do not leave T invariant, but 
only leave some vertex stabilizer G v invariant. Assuming that G v equals its normalizer, 
there is a natural map p v : Out(G; G v ) — > Out(G„) and 

Out(G v }TM$\V\G v ,n\G v ) c Pv(Out(G;G v ,V,H {t) )) C Ont(G v ;V\ Gv ,n\2 v ). 
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Twists. We now consider the kernel of the product map p : Out (T) — > YlveV Out(G„). 
It consists of automorphisms in Out (T) having, for each v, a representative in Aut(T) 
whose restriction to G v is the identity. If T is relative to V, the group ker p is contained 
in Out(T;7>W). 

To study ker p, we need to introduce the group of twists T associated to T or equiva- 
lently to T (we write T(T) or T(T) if there is a risk of confusion). 

Let e be a separating edge of T with origin v and endpoint w. Then G = A *c e B 
with G v C A and G w C B. Given g € Zc v {G e ), one defines the twist by g around e near 
v as the (image in Out(G) of the) automorphism of G equal to the identity on B and 
to conjugation by g on A. There is a similar definition in the case of an HNN extension 
G = A*c = (A,t \ tct^ 1 = (p(c),c G C): given g S Za{C), the twist by g is the identity 
on A and sends t to tg. 

The group T is the subgroup of Out(G) generated by all twists. It is a quotient of 
]^[ e6 £ Zo o(e) (G e ) and is contained in ker p. The following facts follow directly from Section 
2 of [Lev05a| . 

Lemma 2.12. 1. If every Out(G e ) is finite, then T has finite index in ker p. 

2. Assume that every non-oriented edge e of V has an endpoint v such that Nc v (G e ) 
acts on G e by inner automorphisms (this holds in particular if G v is abelian, or if 
G e is malnormal in G v , or if G e is infinite and almost malnormal in G v ). Then 
T = ker p. □ 

The kernel of the epimorphism from LJ egB ^G o{e) (G e ) to T is the image of a natural 
map 

j : J] Z(G V ) x H Z(G e ) [] Z Go( JG e ) 

v<=V ee£ e<EE 

where £ is the set of non-oriented edges of T. The image of an element of Z(G V ) is called 
a vertex relation at v, the image of an element of Z(G e ) is an edge relation. 

For instance, if T is a non-trivial amalgam G = A *c B, then T is the image of the 
map p : Za(C) x Zb(C) — > Out(G) sending (a, b) to the class of the automorphism acting 
on A as conjugation by a and on B as conjugation by b. The kernel of p is generated by 
the elements (a, 1) with a € Z(A) and (1,6) with b G Z(B) (vertex relations), together 
with the elements (c, c) with c £ Z(C) (edge relations). 

Lemma 2.13. Let e be an edge of T with origin v. If Z(G e ) and Z(G V ) are finite, but 
^G v (G e ) is infinite, then the image of Zo v (G e ) in T is infinite. In particular, T is infinite. 

Note that Zc v (G e ) is infinite if Nc v (G e ) is infinite and G e is finite. 

Proof. It is pointed out in |Lev07l Lemma 3.2] that the image of ZQ v {G e ) in T maps 
onto the quotient Zc v (G e )/ {Z(G V ), Z(G e )). Since Z(G V ) and Z(G e ) are commuting finite 
subgroups, this quotient is infinite. □ 

Let r be a graph of groups with fundamental group G, and To C T a connected sub- 
graph. We view Tq as a graph of groups, with fundamental group Go C G and associated 
group of twists T(Tq) C Out(Go). 

Lemma 2.14. IfT(T$) is infinite, then so is T(r). 

Proof. Let Eq be the set of oriented edges of Tq. The projection from fleeE ^G o{e) (G e ) to 
rieeEo ^G„ (e) {G e ) obtained by keeping only the factors with e C Tq is compatible with the 
vertex and edge relations, so induces an epimorphism from T(T) to 7~(Tq). □ 

Lemma 2.15. IfT is a graph of groups with T(T) infinite, there is an edge e such that 
the graph of groups T e obtained by collapsing every edge except e has T(T e ) infinite. 
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Proof. There is an edge e such that Zq o ^ (G e ) has infinite image in Out(G). Twists of T 
around e are also twists of r e . □ 



2.7 Trees of cylinders |GLlTj 

We recall some basic properties of the tree of cylinders (see |GL11] for details) . Besides A 
(and possibly V), we have to fix a conjugacy-invariant subfamily £ C A and an admissible 
equivalence relation ~ on £. Rather than giving a general definition, we describe the 
examples that will be used in this paper: 

1. £ consists of all finite subgroups of a fixed order k, and ~ is equality. 

2. G is relatively hyperbolic (see Section [3]), £ consists of all infinite elementary sub- 
groups (parabolic or loxodromic), and ~ is co-element arity: A ~ B if and only if 
(A, B) is elementary. 

3. G is a torsion-free CSA group, £ consists of all infinite abelian subgroups, and ~ 
is commutation: A ~ B if and only if (A, B) is abelian (recall that G is CSA if 
centralizers of non-trivial elements are abelian and malnormal). 

Let T be a tree with edge stabilizers in £. We declare two (non-oriented) edges e, / 
to be equivalent if G e ~ Gf. The union of all edges in an equivalence class is a subtree 
Y, called a cylinder of T. Two distinct cylinders meet in at most one point. The tree of 
cylinders T c of T is the bipartite tree such that Vq(T c ) is the set of vertices x of T which 
belong to at least two cylinders, V\(T C ) is the set of cylinders Y of T, and there is an edge 
e = (x, Y) between x and Y in T c if and only if x 6 Y. In other words, one obtains T c 
from T by replacing each cylinder Y by the cone on its boundary (defined as the set of 
vertices of Y belonging to some other cylinder) . Note that T c may be trivial even if T is 
not. 

The tree T c is dominated by T (in particular, it is relative to V if T is). It only depends 
on the deformation space T> containing T (we sometimes say that it is the tree of cylinders 
of T>). In particular, T c is invariant under any automorphism of G leaving T> invariant. 

The stabilizer of a vertex x £ Vq{T c ) is the stabilizer of x, viewed as a vertex of T. The 
stabilizer Gy of a vertex Y E V\{T C ) is the stabilizer Gc of the equivalence class C G £/ ~ 
containing stabilizers of edges in Y, for the action of G on £ by conjugation. It is the 
normalizer of a finite subgroup in case 1, a maximal elementary (resp. abelian) subgroup 
in case 2 (resp. 3). Note that A C Gq if A £ £ and C is its equivalence class. 

The stabilizer of an edge e = (x,Y) of T c is G e = G x fl Gy; it is elliptic in T. In 
cases 2 and 3, G e belongs to A. But, in case 1, it may happen that edge stabilizers of T c 
are not in A, so we also consider the collapsed tree of cylinders T* obtained from T c by 
collapsing all edges whose stabilizer does not belong to A (see Section 5.2 of |GLllj ). It 
is an (A,V)-tree if T is, and (T*)* = T*. 

3 Relatively hyperbolic groups 

In this section we assume that G is hyperbolic relative to a finite family V = {Pi, . . . , P n } 
of finitely generated subgroups; we say that V is the parabolic structure. 

The group G is finitely generated. It is not necessarily finitely presented, but it is 
finitely presented relative to V [Osi06bJ, so JSJ decompositions relative to V exist. In 
particular, there is a deformation space of relative Stallings-Dunwoody decompositions 
(see Subsection 12 . 5() . 
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3.1 Generalities 



We refer to [HrulOj for equivalent definitions of relative hyperbolicity. In particular, G acts 
properly discontinuously on a proper geodesic <5-hyperbolic space X (which may be taken 
to be a graph [GM08] ) , the action is cocompact in the complement of a G-invariant union 
B of disjoint horoballs, and the Pi's are representatives of conjugacy classes of stabilizers 
of horoballs. 

A subgroup of G is parabolic if it is contained in a conjugate of some Pi, loxodromic if 
it is infinite, virtually cyclic, and not parabolic, elementary if it is parabolic or virtually 
cyclic (finite or loxodromic). The group G itself is elementary if it is virtually cyclic or 
equal to a Pj. We say that A is an elementary subgroup of B if it is elementary and 
contained in B. 

One may remove any virtually cyclic subgroup from V, without destroying relative 
hyperbolicity (see e.g. [DS051 Cor 1.14]). Conversely, one may add to V a finite subgroup 
or a maximal loxodromic subgroup (see e.g. |Osi06aj ). These operations do not change 
the set of elementary (or relatively quasiconvex, as defined below) subgroups, and it is 
sometimes convenient (as in [HrulOj ^ to assume that every Pj is infinite. 

The following lemma is folklore, but we have not found it in the literature. 

Lemma 3.1. Given a relatively hyperbolic group G, there exists a number M such that 
any elementary subgroup H C G of cardinality > M is contained in a unique maximal 
elementary subgroup E{H), and any finite subgroup of cardinality > M is parabolic. 

Proof. We may assume that every Pj is infinite. Let H be elementary. The existence of 
E(H) is well-known if H is infinite (see for instance [Osi06bJ), so assume H is finite. We 
also assume that the distance between any two distinct horoballs in B is bigger than 65. 
Given r > 0, let X r be the set of points of X which are moved less than r by H. It follows 
from Lemma 3.3 p. 460 of |BH99] (existence of quasi-centres) that X^g is nonempty. 

Arguing as in the proof of Lemma 1.15 page 407 and Lemma 3.3 page 428 in [BH99J, 
one sees that any geodesic joining two points of A 5< 5, or a point of A 5< 5 to a fixed point of 
H in dX, is contained in Xgg. 

If Xgs meets X \ B, properness of the action of G on X \ B implies that there are 
only finitely many possibilities for H up to conjugacy, so we can choose M to ensure 
Xqs C B. This implies that X$s is contained in a unique horoball Bq of B. This horoball 
is if- invariant since horoballs are 6<5-apart, so H fixes the point at infinity £o of -Bo an d 
is contained in the maximal parabolic subgroup E{H) = Stab(Po)- m particular, H is 
parabolic. 

For uniqueness, it suffices to check that H cannot fix any point £ ^ £o i n 9X. If it did, 
a geodesic joining £ to a point of X^ would be contained in Xqs and meet X \ B. This 
contradicts our choice of M. □ 

Since maximal elementary subgroups are equal to their normalizer, we get: 

Corollary 3.2 QDS08, Lemma 4.20]). Maximal elementary subgroups E are uniformly 
almost malnormal: if E n gEg^ 1 has cardinality > M, then g € E. □ 

3.2 Quasiconvexity 

Definition 3.3 (Hruska [HrulOj). Let X andB be as above, andC > 0. A subspace Y C X 
is relatively C -quasiconvex if, given y,y' £ Y, any geodesic [y,y'] C X has the property 
that [y,y'] \ B lies in the C -neighbourhood ofY. The space Y is relatively quasiconvex if 
it is relatively C- quasiconvex for some C. A subgroup H < G is relatively quasiconvex if 
some (equivalently, every) H -orbit is relatively quasiconvex in X. 
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Proposition 3.4. Let G be hyperbolic relative to V = {Pi, ■ ■ ■ , P n }, with Pi finitely gen- 
erated. If G acts on a simplicial tree T relative to V with relatively quasiconvex edge 
stabilizers, then vertex stabilizers are relatively quasiconvex. 

The proposition applies in particular if edge stabilizers are elementary, since elementary 
subgroups are relatively quasiconvex. It was proved by Bowditch [Bow98, Proposition 1.2] 
and Kapovich [Kap97[ Lemma 3.5] for G hyperbolic. We generalize Bowditch's argument. 

Proof. As usual, we assume that G acts on T minimally and without inversion. Since G is 
finitely generated, the graph T/G is finite. We also assume that X is a connected graph, 
and edges of T have length 1. 

Since Pi is elliptic in T, and stabilizers of points of X are finite, hence elliptic in T, 
there exists an equivariant map / : X — > T sending vertices to vertices, mapping each 
edge linearly to an edge path, and constant on each horoball of B. 

For each edge e of T, let m e be the midpoint of e, and Q e = f~ 1 (m e ). Let v be a 
vertex of T, and let E v be the set of edges of T with origin v. Let Q v C X be the preimage 
under / of the closed ball of radius \ around v in T. Note that Q e C Q v for all e G E v 
and Q e n B = 0. Also note that Q e ^ by minimality of T and connectedness of X. 

If f{x) = f(hx) for x G X and h £ G, then h fixes f(x). Since G acts cocompactly 
on X \ B, it follows that G v acts cocompactly on Q v \ B and G e acts cocompactly on 
Qe = Qe \ B- in particular, Q e is the G e -orbit of a finite set. Relative quasiconvexity of 
G e implies that Q e is relatively quasiconvex. Since T/G is a finite graph, there exists a 
common constant C such that all subsets Q e are relatively C-quasiconvex. 

We now fix a vertex v, and we show that G v is relatively quasiconvex. Choose x G 
Q v \ B. Since G v acts cocompactly on Q v \ B, the Hausdorff distance between Q V \B and 
the G^-orbit of x is finite, so it suffices to prove that Q v is relatively quasiconvex. Let 7 be 
a geodesic of X joining two points of Q v , and let 70 be a maximal subgeodesic contained 
in j\Q v . Considering the image of 7 in T, we see that both endpoints of 70 belong to the 
same Q e , for some e G E v . Thus 70 \ B is C-close to Q e , hence to Q v . This shows that Q v 
is relatively C-quasiconvex. □ 

A relatively quasiconvex subgroup is relatively hyperbolic in a natural way ( [HrulO} 
Theorem 9.1]). In particular: 

Lemma 3.5. If G v is an infinite vertex stabilizer of a tree with finite edge stabilizers, it 
is hyperbolic relative to the family V\q v of Definition \2.3[ 

Proof. This follows from Theorem 9.1 of [HrulOj . adding finite groups belonging to V\q v 
to the parabolic structure if needed. □ 

3.3 The canonical JSJ decomposition 

In this section we recall the description of the canonical relative JSJ decomposition. The 
content of the word canonical is that the JSJ tree (not just the JSJ deformation space) is 
invariant under automorphisms. 

Let G be hyperbolic relative to V, and denote by A the family of elementary subgroups. 
In this subsection we fix another (possibly empty) family of finitely generated subgroups 
H = {Hi, . . . , Hq\ and we assume that G is one-ended relative toVWH. 

We consider the canonical Out(G;V U %)-invariant JSJ tree T can defined in Corollary 
13.2 of |GL10| (see also |GLllj ). It belongs to the JSJ deformation space V over elementary 
subgroups relative to V U H, and it is canonical because the JSJ deformation space V is 
Out(G; V U 'H)-invariant and T can is the tree of cylinders of V. 

Recall that T can is bipartite, with vertices x € Vo(T can ) and Y £ Vi(T can ). Stabilizers of 
vertices in Vo(T can ) are non-elementary, and stabilizers of vertices in Vi(T can ) are maximal 
elementary subgroups. There are exactly four possibilities for a vertex v £ T can : 
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O.a. rigid: G v is non-elementary and is elliptic in every (A, V U %)-tree. 

0. b. (flexible) QH: G v is non-elementary and not universally elliptic. Then v is a flexible 

QH vertex with finite fiber as in Subsection 12.51 (see [GL10]). 

1. a. maximal parabolic: G v is conjugate to a Pj. 

l.b. maximal loxodromic: G v is a maximal virtually cyclic subgroup of G, and G v is not 
parabolic. 

Remark 3.6. A QH vertex v E Vo(T can ) is flexible, except in a few cases; for instance, if G 
is torsion-free, the only exceptional case is when the underlying surface is a pair of pants 
(thrice punctured sphere). In these cases we view v as rigid rather than QH. This should 
not cause confusion. In particular, Propositions 14.11 and 14.71 would remain valid with v 
viewed as QH. 

If e = (x, Y) is an edge, then G £ = G x n Gy is an infinite maximal elementary 
subgroup of G x (but G £ may fail to be maximal elementary in G and Gy)- In particular, 
G e is always almost malnormal in G x , so that Assertion 2 of Lemma 12.121 applies to T can , 
showing T = ker p. 

If x is a QH vertex, then G £ is the full preimage of a boundary subgroup of vri(S), so 
Inc„ C B v (see Definitions 12.11 and I2.8[) . If Pi (resp. Hj) is infinite, the intersection of any 
of its conjugates with a QH vertex stabilizer is contained in the preimage of a boundary 
subgroup, in particular is virtually cyclic. 

Conversely, because of one-endedness, every boundary component of £ is used by 
Inc„ U V\g v U ~H\g v '- f° r anv full boundary subgroup B G B v , there exists a subgroup 
H £ Inc„ U V\q v U H\g v such that some (^-conjugate of H is a finite index subgroup of B 
|GL10l Theorem 13.1]. In particular, B v = Inc„ U V\g v if % = and every Pi is infinite 
(and B v = lnc v if H = and no Pi is virtually cyclic). 

A group Pi which is not virtually cyclic is contained in a rigid G x or is equal to some 
Gy (which may be contained in a rigid G x ). A group Hj which is not virtually cyclic is 
contained in a rigid G x or in a Gy. 

Lemma 3.7. T can has finitely generated edge (hence vertex) stabilizers. 

We do not assume that the Pj's are slender, so there may exist infinitely generated 
elementary subgroups. 

Proof. Since G is finitely presented relative to V U H, there is an elementary JSJ tree Tj 
relative to V U H having finitely generated edge stabilizers QGL09 , Theorem 5.1). The 
tree T can is the tree of cylinders of Tj. 

Consider an edge e = (x,Y) of T can , and G £ = G x n Gy. We view Y as a subtree of 
Tj containing x. If Gy is virtually cyclic, then G £ is obviously finitely generated, so we 
can assume that Gy is a maximal parabolic group Pi. 

Since Gy = Pi is elliptic in Tj and leaves Y invariant, it fixes a vertex y € Y. If 
y = x, then Gy C G x , so G £ = Gy = Pi is finitely generated. If y ^ x, let e be 
the initial edge of the segment [x,y] in Tj. It is contained in F, so G e C Gy, hence 
G e C G x n Gy C G x n G y C G e . It follows that G e = G x n Gy = G e is finitely 
generated. □ 

By Proposition 13.41 vertex groups of T can are relatively quasiconvex, hence relatively 
hyperbolic. We make the parabolic structure explicit. 

Lemma 3.8. If x € Vo(T can ), the group G x is hyperbolic relative to the finite family 
of finitely generated subgroups Q x = lnc x U V\g x , where Inc x is a set of representatives 
of conjugacy classes of incident edge stabilizers and V\g x * s the induced structure (see 
Definitions^^ andWlty. 
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Proof. By Theorem 9.1 of [HrulOj . we have to consider infinite groups of the form G x n 
gPig~ l . Recall that stabilizers of vertices adjacent to x are maximal elementary subgroups, 
and distinct maximal elementary subgroups have finite intersection. Thus gP-ig^ 1 must 
be the stabilizer of an adjacent vertex, or have x as unique fixed point, so G x n gPig^ 1 is 
conjugate in G x to a group in Inc x L)V\ Gx . Conversely, a group in Inc^ UP| G:Z . which is not 
an infinite group of the form G x H gPig~ l is finite or is a loxodromic maximal virtually 
cyclic subgroup of G x . Such groups may be added to the parabolic structure. □ 

3.4 Rigid groups have finitely many automorphisms 

Theorem 3.9. Let G be hyperbolic relative to finitely generated subgroups P = {Pi , . . . ,P n }, 
with P{ G. Let P = {Pi, . . . , H q } be another family of finitely generated subgroups. If 
Out(G;P ',H^) is infinite, then G splits over an elementary subgroup relative to V U P. 

The hypothesis means that there are infinitely many (classes of) automorphisms which 
map each Pj to a conjugate (in an arbitrary way) and act on each Hj as conjugation by 
an element of G. 

The proof of the theorem has two steps. First, using the Bestvina-Paulin method (see 
|Pau91j ). extended by Belegradek-Szczepariski [BS08J to relatively hyperbolic groups, one 
constructs an action of G on an R-tree T. Rips theory then yields a splitting. This is 
fairly standard but there are technical difficulties, in particular because the action on T is 
not necessarily stable if the Pi's are not assumed to be slender. Details are in Section [9l 

4 Automorphisms of one-ended relatively hyperbolic groups 

Let G be hyperbolic relative to V = {Pi, ■ ■ ■ , P n }, with Pj infinite and finitely generated. 
We assume that G is one-ended relative to V. In Subsection 14.11 we study Out(G;P) 
through its action on the canonical JSJ tree. This leads to the main results of this section, 
which are stated in Subsection 14.21 In Subsection 14.31 we study automorphisms which act 
trivially on another family P. 

4.1 Automorphisms of the canonical JSJ splitting 

Let T can be the canonical Out(G; P)-invariant JSJ tree as in Subsection 13.31 (with P = 0), 
and r can = T can /G. Edge stabilizers are infinite elementary subgroups. Vertex stabilizers 
may be rigid (non-elementary), QH with finite fiber, maximal parabolic (conjugate to a Pi), 
or maximal loxodromic (virtually cyclic). A rigid or QH stabilizer G x fixes a unique point 
in T can , hence is equal to its normalizer; incident edge stabilizers are maximal elementary 
subgroups of G x . 

We study Out(G; P) through its action on Tcan &s in Section l2.61 In general, Out(G; P) 
is a proper subgroup of Out(T can ). 

We define finite index subgroups Out°(G; P) and Out°(G; P (t) ) by taking the intersec- 
tion of Out(G; P) and Out(G; V®) with the group Out°(T can ) consisting of automorphisms 
acting trivially on the graph r can = T can /G. 

By the second assertion of Lemma \2.Y1\ the kernel of p : Out°(T can ) — > Ylvev Out(G v ) 
is the group of twists T. Note that T C Out (G; P^) C Out°(G;P) since every P is 
elliptic in T can and a twist acts as a conjugation on any vertex stabilizer. 

The group T is the image in Out(G) of a finite direct product IleeB ^G o(e) (G e ). Each 
factor is virtually cyclic or contained in a conjugate of some Pj. 

We now consider the image of Out°(G;P) and Out°(G;PW) by p v : Out (T can ) -> 
Out(G„), for v a vertex of r can (viewed as a vertex of T can with stabilizer G v ). Using 
Theorem 13.91 we shall show that both images are finite if G v is rigid. If G v = Pi, the index 
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of Out(G„; Inci, ) in the image of Out (G;P) is finite because w is rigid whenever e = vw 
is an edge with Out(G e ) infinite. More precisely: 

Proposition 4.1. The images of Out (G;V) and Out°(G;pM) by p v : Out°(T can ) -> 
Out(G u) tocj?/ 6e described as follows: 

• If G v is virtually cyclic or rigid, both images are finite. 

• If G v is a QH vertex stabilizer, both images contain Out(G v ;B v ) with finite index. 

• If G v is (conjugate to) Pi, the image of Out°(G; pw) is trivial. The image of 
Out°(G;P) contains Out(G„; InCt, ) with finite index. 

If e is any edge o/T can , the images o/Out°(G;P) and Out°(G;7 7 ^) by p e : Out°(T can ) — > 
Out(G e ) are finite. 

See Definition 12.81 for the definition of the family of full boundary subgroups B v , and 
recall that B v = Inc„ if no Pj is virtually cyclic. 

Proof. If G v is virtually cyclic, Out(G„) is finite. If G v is rigid, finiteness follows from 
Theorem 13.91 as we now explain. We have seen (Lemma l3.8p that G v is hyperbolic relative 
to a finite family Q v = Inc„ U V\q v consisting of incident edge groups and conjugates of 
the P^s having v as unique fixed point. These groups are finitely generated by Lemma 
13.71 By Lemma |2.10| the group p v (Out°(G; V)) is contained in Out(G v ; Q v ). If it is 
infinite, G v splits over an elementary subgroup relative to Q v by Theorem 13.91 (applied 
with V = Q v and T~L = 0). By Lemma[2]6j this splitting may be used to refine T can , yielding 
an elementary splitting of G relative to V in which G v is not elliptic. This contradicts 
rigidity. 

If G v is QH, first note that Out(G„; B v t] ) = Out(G„;Incl t) ,P,gj and Out{G v ;B v ) = 
Out(G v ; Inc„, V\g v ) because B v = lnc v UV\g v (see Subsection 13.31 recalling that groups in 
V are assumed to be infinite). 

Lemma 12.101 then yields 

Out(G v ;fiW) C ^(Out°(G;P (t) )) C p„(Out (G; V)) C Out(G„;£„). 

We conclude by observing that Out(G v ;B v •) has finite index in Out(G v ;B v ) because 
groups in B v are virtually cyclic, hence have finite outer automorphism group. 

If G v is (conjugate to) Pj, the image of Out°(G; pw) \ s clearly trivial. Since V\q v equals 

{G v } or is empty, the image of Out°(G; P) contains Out(G„;Inc.y ) = Out(G„;Inc| V\g v ), 
and we have to show that the index is finite. If Out(G E ) is finite for every incident edge e, 
this follows from Lemma [2.101 In general, we have to control the action of automorphisms 
on G £ for incident edges e with Out(G e ) infinite. Note that there is no natural map from 
Out(G„; Inc„) to Out(G e ) if Ng v (G £ ) acts non-trivially on G £ . 

Infiniteness of Out(G e ) implies that the other endpoint of e is a rigid vertex x: it 
cannot be QH since G £ would then be virtually cyclic. As explained above, the image of 
Out°(G;P) in Out{G x ) is finite. Any $ E Out°(G;P) has a representative a leaving G x 
and G v invariant (the associated map f a fixes e). Replacing Out (G;P) by a finite index 
subgroup, we may suppose that a acts on G x as conjugation by some element g. This 
g must be in G x since G x equals its normalizer, and in fact in G £ because G £ is almost 
malnormal in G x . This shows that <3? maps into Out {G v ;G { £ t] ). Ar guing in this way for 
each incident edge proves the result for the image of p v . 

Since any edge of T can has a vertex v with G v virtually cyclic or conjugate to a Pj, the 
previous argument also shows finiteness for images by p e . □ 

Definition 4.2. Let S be a compact 2-dimensional hyperbolic orbifold. The extended 
mapping class group MGG*(S) is the group of outer automorphisms o/7Ti(S) preserving 
the set of boundary subgroups. 



16 



If v is a QH vertex of T can with underlying orbifold E and finite fiber F, we define 
MGGy (E) as the group Out{G v -B^). This group maps with finite kernel onto a finite 
index subgroup ofMCG*(T.) [DUlll pp. 240 and 268]. 

As noted in [Fu j02|lDGll| . one can understand the extended mapping class group of 
an orbifold with mirrors in terms of the extended mapping class group of a suborbifold 
without mirrors. 

If G is torsion free, E is a surface, MGG*(E) is the group of isotopy classes of home- 
omorphisms, and MCGj,^(Yi) is the group of isotopy classes of homeomorphisms which 
map each boundary component to itself in an orientation-preserving way (in this case it 
only depends on E since the fiber is trivial). 

Mapping class groups are usually infinite, but there are exceptions. In the torsion- 
free case, the exceptions are the pair of pants and the twice punctured projective plane 
|Kor021 Cor 4.6]; all other hyperbolic surfaces contain an essential 2-sided simple closed 
curve not bounding a Mobius band, so there is a Dehn twist of infinite order. As a 
QH vertex, a pair of pants is rigid; every simple closed curve is homotopically trivial or 
boundary parallel. A twice punctured projective plane is flexible, but every 2-sided simple 
closed curve is homotopically trivial, boundary parallel, or bounds a Mobius band, so there 
is no non-trivial Dehn twist. 

4.2 Automorphisms of G 

Motivated by the previous subsection, we define a subgroup Out x (G; P^) C Out°(G; P^) 
as the set of <E> such that p v (&) is trivial if G v is virtually cyclic, rigid, or conjugate to a Pi, 
and p v (<$>) G Out(G v ;B$) = MCG^JS) if G v is QH. Proposition O shows that this 
subgroup has finite index. We define a finite index subgroup Out 1 (G;P) C Out°(G;P) 
similarly, allowing p v ($>) G Out(G„;Inc^) if G v is conjugate to a p. 
We may now sum up the discussion in Subsection 14.11 as: 

Theorem 4.3. Let G be hyperbolic relative to P = {Pi, . . . , P n } , with Pi infinite and 
finitely generated. Assume that G is one-ended relative to V . 

ThenOut(G;V (t) ) and Out(G;V) havefinite index subgroups Out 1 (G;P^) and Out 1 (G; V) 
which fit in exact sequences 

v 

1 _> T ^ Out 1 (G; P® ) -»• J] MGG° can (E<) -)• 1 

t=i 

v 

1 -> T -> Out 1 (G;7') -»• JjMGG^ can (Si) x T JOut(P i ;Inc^ ) ) -»• 1 

i=i j 

where: 

• T is the group of twists of the canonical elementary JSJ decomposition T can relative 
to P; it is a quotient of a finite direct product where each factor is a subgroup of G 
which is virtually cyclic or contained in a Pi; 

• Si, . . . , S p are the 2-orbifolds occuring inflexible QH vertices v ofT can , and MGG^ can (Ej) 
maps with finite kernel onto a finite index subgroup of the extended mapping class 
group MCG*(Ei); 

• the last product is taken only over those Pj 's which occur as vertex stabilizers o/T cariJ 
and Inc p. is the set of incident edge groups. □ 

Note that T is slender (resp. small, virtually solvable, virtually nilpotent, virtually 
abelian) if the Pj's are. Also note that Out(G; P) has finite index in Out(G) if the Pj's are 
small but not virtually cyclic, since they may be characterized up to conjugacy as maximal 
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among the subgroups of G which are small but not virtually cyclic. More generally, this 
holds if no Pi is relatively hyperbolic [MO, Lemma 3.2]. 

Recall that G is toral relatively hyperbolic if it is torsion-free and hyperbolic relative to 
a finite family V of finitely generated abelian subgroups. Limit groups, and more generally 
groups acting freely on IR n -trees, are toral relatively hyperbolic [Dah03b|lGui04j . 

Corollary 4.4. Let G be toral relatively hyperbolic and one-ended. Then some finite index 
subgroup Out^G) o/Out(G) fits in an exact sequence 

p m 

1 ->■ T -> Out^G) -+ jjMCG°(Ei) x Yl GL rkyHk (Z) -> 1 

i=l k=l 

where T is finitely generated free abelian, MGG°(Ej) is the group of isotopy classes of 
homeomorphisms of a compact surface Sj mapping each boundary component to itself 
in an orientation-preserving way, and GL rjn (Z) = M rjn (Z) xi GL r (Z) is the group of 
automorphisms of Z n+r fixing the first n generators. 

See Theorem 5.3 of [BKM07 and Theorem 6.5 of [GL07b] for the case of limit groups, 
based on results from |KM05j and |BKM07j . 

Proof. We may assume that no Pi € V is cyclic, so Out(G; V) has finite index in Out(G). If 
Pj is isomorphic to Z a , then Out(Pj; Inc^) is isomorphic to some GL rj „(Z) with r + n = a, 
so the exact sequence follows from Theorem 14.31 We know that the group of twists T of 
T can is finitely generated and abelian. There remains to check that it is torsion-free. 

Recall from Subsection 12 . 61 that T is generated by the product of all %G a u\ (G=), subject 
to edge and vertex relations. Denoting an edge of r can = T can /G by e = (x,Y) with 
x £ Vo(r can ) and Y € Vi(T can ), there is no relation at the vertex x since Z(G X ) is trivial. 
Moreover, Zg x (G £ ) = G £ , so the edge relation identifies the twists around e near x with 
twists near Y . Thus T is the direct product, over vertices v of r can carrying an abelian 
group, of (rieG-B ^G v {G e )) / Z{G V ) where E v is the set of oriented edges with origin v and 
Z(G V ) is embedded diagonally. Since G v is abelian, Zc v (G e ) = Z(G V ) = G v , so T is 
isomorphic to a finite direct product n(^f of abelian vertex groups. It is therefore 

torsion-free. □ 

Corollary 4.5. If G is a toral relatively hyperbolic group, Out(G) is virtually torsion-free 
and has a finite index subgroup with a finite classifying space. 

Proof. This follows from Corollary 23] if G is one-ended. In general, we can apply Theorem 

5.2 of [GL07bj since G has a finite classifying space [Dah 03a] . □ 

4.3 The relative case 

We generalize the analysis of Subsection 14.11 to a relative situation. 

Let G,V be as above, and fix another family of finitely generated subgroups % = 
{Hi, ... ,H q }. Assume that G is one-ended relative to V U H, and let now T can be the 
canonical elementary JSJ tree relative to V U H. 

Theorem 4.6. Under these hypotheses, Out(G; V® , H®) and Out(G; V, % (t) ) have finite 
index subgroups Out^G; P (t) , «(*)) and Out^G; V, U {t) ) which fit in exact sequences 

p 

1 -> T -> Out\G;V^,n {t) ) ->■ Y\ M GG^ can (Ej) -> 1 

i=i 

p 

1 ->-r-> Out^G;^,^) -> J|MGG^ can (E,) x ]J Out(P,-; Incg, «g ) ^ 1 
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as in Theorem \4-3[ 

The group MCG\ (£j) equals Oui(G v ;Bi , Tv ), where T v is a set of represen- 
tatives of conjugacy classes of finite subgroups in G v ; it is a finite index subgroup of 

MCG T can ( S <) = Out(G„;M t} ). 

Note that J- v is a finite set since the QH vertex group G v maps onto a 2-orbifold group 
with finite kernel. 

The theorem is proved as in the absolute case, replacing Proposition ^. ll bv the following 
result. 

Proposition 4.7. The images of 'Out°(G;V,H (t) ) and Out (G;V® ,H®) by p v : Out°(T can ) -> 
Out(G„) may be described as follows: 

• If G v is virtually cyclic or rigid, both images are finite. 

• If G v is a QH vertex stabilizer, both images contain Out(G v ; 13^,7-^) with finite 
index (where T v is as in Theorem \4-6\ and B v is as in Definition \2. 8\) . 

• If G v is (conjugate to) Pi, the image of Out°(G; H^) is trivial. The image of 
Out°(G;V,'H^) contains Out(GV,; Inc^, HjQ ) with finite index. 

Proof. We only mention the differences with the proof of Proposition 14.11 

If v is a (non-elementary) rigid vertex, the images of Out°(G; V, ) and Out°(G; , ) 

by p v are contained in in Out(G„; Q v ,1-Uq ) by Lemma \2. 101 It follows that the images are 

finite since, otherwise, Theorem 13.91 would yield a splitting relative to Q v U H\g v i which 

extends to a splitting of G relative to V U TL by Lemma 12.61 

When G v is conjugate to a parabolic group Pj, Lemma f2.10l savs that the image of 

Out°(G; V, H^) contains Out(G v ;InCti , Ti^, ), and the index is finite for the same reason 
as before. 

When G v is QH, the new feature is that H\g v m &y contain some finite subgroups 
(infinite groups in 1~L\g v are contained in groups of B v , up to conjugacy). We get 

0\it(G v iB®,jf>) C Pv (Out°(G;V {t \n {t) )) C p v (Out°(G; V, H {t) )) C Out(G v ;B v ) 
and the indices are finite. □ 

Remark 4.8. Because we use Theorem 13.91 to control automorphisms of rigid groups, we 
do not have a similar result concerning Out(G;PW UU) or Out(G; V U H): we have to 
impose that automorphisms act trivially on %. We also need finite generation of groups 
in n. 

Corollary 4.9. Let G be toral relatively hyperbolic, one-ended relative to a family T-L = 
{Hi, . . . , H q } of finitely generated subgroups. Then Out(G;T~L^) has a finite index sub- 
group Out 1 (G;H^) fitting in an exact sequence as in Corollary \4-4\ D 

5 The modular group 

The goal of this section is to show that the modular group, usually defined by considering 
all suitable splittings of a group G, may be seen on a single splitting, namely the canonical 
JSJ decomposition. 

5.1 Definitions and examples 

Let G be hyperbolic relative to V = {P%, . . . , P n }, where each Pi is finitely generated. 
Without loss of generality, we assume that no Pi is virtually cyclic. Let H be another 
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finite family of finitely generated subgroups Hj such that every Pj which contains a free 
group F2 is contained in a group of H. 

In particular, we may take H = V, or H = if every Pj is small. We will assume that 
G is one-ended relative to H (equivalently, relative to V U H since every Pj is one-ended 
or contained in a group of H). 

We consider trees T with elementary edge stabilizers, which are relative to H (universal 
ellipticity will be with respect to these trees, unless indicated otherwise). They are not 
necessarily relative to Pj if Pj is small, but our assumption on % implies that elementary 
subgroups which are not small have a conjugate contained in a group in H, so are univer- 
sally elliptic. We shall associate a modular group Mod(T) C Out(T) C Out(G) to such a 
tree T. 

Lemma 5.1. If v is a flexible QH vertex with finite fiber, then any elementary subgroup 
of G v is virtually cyclic. 

Recall (Definition E2D that G v maps onto 7Ti(S) with finite kernel P; flexibility of 
G v is equivalent to the 2-orbifold £ containing an essential 1-suborbifold. Since T is 
only assumed to be relative to H, Definition 12.71 only restricts intersections of G v with 
conjugates of groups in H. 

Proof. Assume on the contrary that some subgroup E < G v is elementary, but not virtually 
cyclic. Then E contains P2 and is parabolic. As pointed out before, our assumption on 
H implies that E is universally elliptic. This contradicts Remark 12.91 saying that such a 
group has to be virtually cyclic. □ 

Remark. If G v is a flexible QH vertex stabilizer with elementary fiber P, then P is finite. 
Indeed, if P is infinite, then G v is elementary by almost malnormality of maximal elemen- 
tary subgroups (Corollary 13. 2|) . Since it contains P2, it is universally elliptic, contradicting 
flexibility. 

Definition 5.2. We say that a vertex v ofT (orofT = T/G) is modular if G v is flexible 
and QH with finite fiber, or G v is elementary. Note that G v cannot be both. 

Recall (Subsection I2.6p the maps p v : Out (T) — > Out(G„) defined on the finite index 
subgroup of Out(T) consisting of automorphisms acting trivially on T = T/G. 

Definition 5.3. We define Mod(T) by saying that $ € Out°(T) belongs to Mod(T) if it 
satisfies the following conditions: 

• If v is not modular, p v (&) is trivial. 

• If G v is elementary, p v (&) £ OvA(G v ; Inc„ ); in other words, p v (3>) acts on each 
incident edge group as a conjugation. 

• If G v is QH with finite fiber, and flexible, then p v ($>) € Out(G v ;Bv), with B v 
consisting of full preimages of boundary subgroups of tti(T,) as in Definition \2.8\ . 

Note that Mod(T) contains the group of twists T(T). 

We have assumed that G is one-ended relative to H, so we can consider the canonical 
elementary JSJ tree T can relative to V U H as in Subsection 13.31 Note that Mod(T can ) 
has finite index in Out(G;P) when % = V (it contains the group OvA 1 {G;V) defined m 
Subsection 14. 2\ possibly strictly because of vertices with G v virtually cyclic). 

Theorem 5.4. Let G be hyperbolic relative to V = {Pi,...,P n }, with each Pi finitely 
generated, not virtually cyclic. Let H be a family of subgroups such that every Pi which 
contains P2 is contained in a group ofH, and G is one-ended relative to H. 

IfTis any elementary splitting of G relative to H, then Mod(T) C Mod(T can ), where 
Pcan is the canonical elementary JSI tree relative to V U %. 
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This applies in particular if G is one-ended and no Pi contains F2 (taking H = 0) , or if 
G is one-ended relative to an arbitrary V and we restrict to splittings relative to V (taking 
H = V). 

Remark 5.5. Rather than defining Mod(T) by imposing conditions on the action on ver- 
tex groups, as we just did, one could define it by giving generators: twists around edges, 
and certain automorphisms of vertex groups. This would yield a slightly smaller group 
Mod'(T): its intersection with ker p is T, whereas Mod(T) contains all of ker p. The- 
orem 15.41 (and Theorem 15.61 below) also hold with this more restrictive definition, since 
Mod'(T can ) = Mod(T can ) by Assertion 2 of Lemma [2T2J 

There is a similar statement for torsion-free CSA groups (recall that G is CSA if 
centralizers of non-trivial elements are abelian and malnormal). We now consider abelian 
splittings of G. A vertex v is modular if G v is either abelian or QH as above (in this case 
F is trivial and £ is a surface). The definition of Mod(T) is the same (with elementary 
replaced by abelian). The tree T can is the canonical abelian JSJ tree relative to non- 
cyclic abelian subgroups; it is also the tree of cylinders of the (non-relative) abelian JSJ 
deformation space (see Theorem 11.1 of [GLlOj ). 

Theorem 5.6. Let G be a finitely generated, torsion-free, one-ended, CSA group. IfT is 
any splitting of G over abelian groups, then Mod(T) C Mod(T can ) ; where T can is the tree 
of cylinders of the abelian JSJ deformation space. 

Example 5.7. Let G be the Baumslag-Solitar group BS(2,4) = {a, b \ baPb' 1 = a 4 ). Any 
splitting of G as a graph of infinite cyclic groups is a cyclic JSJ decomposition of G 
|For03tlGL09| . Its modular group coincides with its group of twists, and is a finite abelian 
group (see |Lev07j ) . But the JSJ deformation space of BS(2,A) is quite large fCla09], 
and JSJ splittings of BS(2, 4) may have modular groups of arbitrarily large order. In 
particular, there is no splitting whose modular group contains all others. 

Example 5.8. Even if G is as in Theorem 15.41 one cannot replace T can by an arbitrary 
tree in its deformation space: there exists such trees whose modular group is not maximal 
(even up to finite index). 

Indeed, let G = A\ *Ci B *c 2 A2, where: 

• Ai and A2 are torsion-free hyperbolic groups with no cyclic splitting; 

• Ci is a maximal infinite cyclic subgroup of Ai; 

• B is torsion- free, hyperbolic relative to a subgroup C = C\ © C2 © Z ~ Z 3 , and does 
not split over an abelian group. 

The group G is hyperbolic relative to C by [Dah03bJ. 
The graph of groups 

B 

CieC 2 

A x —— Ci © C 2 A 2 

is an elementary JSJ decomposition of G (both absolute and relative to C) because its 
vertex groups are universally elliptic (see Lemma 4.7 of [GL09J). Given any z € C \ {C\ © 
C2), the automorphism r defined as the identity on A\ and B and as conjugation by z on 
A2 is not an automorphism of this graph of groups. But r is a twist of T can , which is the 
Bass-Serre tree of the graph of groups below. 

B 

C 
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5.2 Proof of Theorem 15.41 



We prove Theorem 15.41 The proof of Theorem 15.61 is similar and left to the reader. The 
main difference in the context of a general CSA group is that we have no version of 
Theorem 13 . 91 saving that a rigid vertex group only has finitely many outer automorphisms. 
But the proof given below does not use Theorem 13.91 

By Theorem 13.1 of |GL10j . the trees T can and T are compatible: they have a common 
refinement T (as defined in Subsection l2.3p . We may assume that no edge of T is collapsed 
in both T can and T (so T is the 1cm of T can and T as defined in Section 3 of [GL10J). The 
tree T has elementary edge stabilizers and is relative to T-L since Tcan and T are (Proposition 
3.22 of [HTTP] ). 

Let $ £ Mod(T) . The heart of the proof is to study the action of $ on a non-elementary 
vertex stabilizer G v of T can (it is rigid or QH). In particular, given an edge e = vw in T can , 
we show that $ has a representative a leaving G v invariant and equal to the identity on 
G e . 

We have defined JSJ tree relative to V U 7i. When T can is viewed as relative 

to 7i only, a flexible QH vertex remains flexible QH. It follows from Sections 8 and 13 
of |GL10j that a rigid (non-elementary) vertex stabilizer G v of T can remains universally 
elliptic relative to H. The argument goes as follows: if T is an elementary splitting relative 
to H, then G v is elliptic in its tree of cylinders T c because T c is relative to % U V and 
G v is rigid relative to % U V; since groups elliptic in T c but not in T are elementary (see 
Subsection 12. 7p . and G v is not, this implies that G v is elliptic in T. 

We distinguish two cases. 

Case 1: v is rigid. Then G v is universally elliptic, so fixes a point u in T, which is 
unique because edge stabilizers are elementary and G v is not. The group G u cannot be 
elementary. By Remark l2.9| it cannot be flexible QH because its subgroup G v is universally 
elliptic and non-elementary. Thus u is not modular and <3? has a representative a equal to 
the identity on G u , hence on G v . 

Case 2: v is a flexible QH vertex of T can . Let e be an adjacent edge and e its lift to T. 
Recall that G e = Ge is a maximal elementary subgroup of G v . We define a point v G T as 
follows. If G v is elliptic in T, we call v its unique fixed point. If it is not elliptic, its action 
on its minimal subtree in T is dual to a family of 1-suborbifolds of £ (see Lemma 7.4 of 
[GL09]). We let v be the point of that subtree closest to e (possibly an endpoint of e). 

The stabilizer of v is QH, associated to a suborbifold S of S (if £ contains no essential 
1-suborbifold, v is a rigid vertex of T). Note that G% is non-elementary by Lemma 15.11 
The stabilizer of e, and also of edges between e and v if any, is contained in G%, in fact in 
the preimage of a boundary subgroup of 7Ti(£) and 7Ti(E). 

Let u be the image of v in T. 

Subcase 2a: u is not modular. Then $ has a representative a equal to the identity 
on G u , hence on G$ and on G e = G e . Note that a leaves G v invariant because a is an 
automorphism of T can and v is the only vertex of T can fixed by G{, . 

Subcase 2b: G u is QH with finite fiber. Then G u is elliptic in T can (see Proposition 
7.13 of [GL09j l. hence in f [GL101 Proposition 3.22], so G u = G c . Unfortunately, this 
argument says nothing about incident edge groups at u. 

First suppose that v is an endpoint of e. Choose an edge path with origin v, starting 
with e, such that all edges except the last one get collapsed to u in T (this path consists 
of the single edge e if e is not collapsed to a point in T). Call this last edge e', and its 
initial vertex a. We have G& C G a C G u = Ga, so G e > C G e . 

The group G u is QH with finite fiber, and G e * is an incident edge group. It is infinite 
by one-endedness, so is contained in a unique maximal elementary subgroup C of G u (the 
preimage of a boundary subgroup of the underlying 2-orbifold). Since G e > C G e , we have 
G e C C. By definition of Mod(T), there is a representative a of $ leaving G u invariant 
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and equal to the identity on G, hence on G e = G e . As above, a leaves G v invariant. 

If there are edges between v and e, call e! the edge that contains v. It is not collapsed 
to a point in T, since it is collapsed in T^ an , so Gg/ is an incident edge group of G u . We 
now have Ge C Gg C C and we argue as in the previous case. This completes the analysis 
of the action of <3? on G e in case 2. 

Still in case 2 (i.e. assuming that v is a flexible QH vertex stabilizer of T can ), we also 
need to understand the action of <J> on an element B G B v which is not an incident edge 
stabilizer. Such a B contains a conjugate of an Hj with finite index. 

By minimality of T, the group B fixes a QH vertex v G T. We then argue as above. 
In subcase 2b, we have B G B u (up to conjugacy) because B contains a conjugate of Hj, 
so we can find a leaving G u invariant and equal to the identity on B since $ G Mod(T). 
This finishes case 2. 

We can now conclude. Consider r can = T can /G, and recall that T can is a tree of 
cylinders, so r can is bipartite, with edges joining a vertex x G Vo(r can ) carrying a non- 
elementary group to a vertex Y G Vi(r can ) carrying an elementary group. We know that 
$ fixes each vertex x G Vo(r can ), and its action on G x is trivial if x is not modular, in 
Out^;^) if G x is QH. 

Since T can is a tree of cylinders, distinct edges of r can with origin x in Vb(r can ) carry 
groups which are not conjugate in G x . As p x (&) G Out(G x ; Inc^), we deduce that <J> 
acts as the identity on edges of r can with origin x, hence on the whole of r can . Thus 
$ G Out°(T can ). 

There remains to check that py(&) £ Out(Gy ; Inc^) for Y G Vi(r can ). If e = (x,Y) 
is an adjacent edge, we have seen that $ has a representative a equal to the identity on 
G £ . Since G £ is infinite, Gy is the unique maximal elementary subgroup containing it, so 
a leaves Gy invariant. This completes the proof. 

6 Induced automorphisms 

In this section G is hyperbolic relative to V = {Pi, ■ ■ ■ , P n }, an d we study automorphisms 
of P\ which are induced by automorphisms of G. We then apply this to the case when G is 
hyperbolic and H is a malnormal quasiconvex subgroup, viewing G as hyperbolic relative 
to H. 

Definition 6.1. Given families of subgroups V and W, and a subgroup Q, we say that 
a G Aut(Q) is extendable to G relative to V and "My' if it is the restriction to Q of an 
automorphism of G representing an element of Out(G; V, M^). 

Being extendable only depends on the image of a in Out(Q), so we define the group 
of extendable automorphisms Out(Q f(G; V, M (t) )) C Out(Q). We write Out(Q /(G; V)) 
when U = $, and Out(Q f G) for Out(Q /(G; 0)) = Out(Q f{G\ {Q})). 

If Q equals its normalizer (for instance if Q is an infinite maximal parabolic subgroup), 
there is a map Out(G;Q) — > Out(Q), and Out(Q / G) is its image. 

Suppose that Pi = G v is a vertex group of a splitting of G relative to V = {Pi, . . . , P n }, 
and Pi contains no conjugate of Pj for i > 1 (this is automatic if no Pj is finite). Then 
Out(Pi J~(G;V)) contains Out(G,;; Inc^) (see Lemma f2. lUp . The following theorem says 
that virtually all extendable automorphisms occur in this fashion. 

Theorem 6.2. Let G be hyperbolic relative toV = {Pi, ■ ■ ■ , P n }, with Pi finitely generated 
and infinite, and Pi ^ G. Let H be a finite family of finitely generated subgroups of G. If 
Out(Pi /(G;P,% (t) )) is infinite, then: 

1. Pi is a vertex group G v in an elementary JSJ decomposition T relative to V DTI. 
Edge groups of T are finitely generated. 
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2. The group Out(Pi /(G; P, %W)) C Out (Pi) has a finite index subgroup equal to 
Out(Pi; K^), where K = \tic v {J'H\q v is a finite family of finitely generated subgroups 
of P\ (the family of incident edge groups lnc v , and ~H\g v > are defined in Subsection 

Since we do not assume that G is one-ended relative to V U H, there is no canonical 
JSJ decomposition. 

Proof. • First assume that G is one-ended relative to V U H. Consider the canonical 
elementary JSJ tree T can relative to P U 7i as in Subsection 13.31 

Let G v be a vertex stabilizer containing Pi. It cannot be flexible QH because Pi is not 
virtually cyclic (see Remark 12 .9|) . If it is rigid (non-elementary), we have seen in Subsection 
IPlthat the image of Out (G;V,H®) in Out(G„) is finite (recall that Out (G;V,H^) is 
the finite index subgroup of Out(G;P,%W) acting trivially on T can /G). Since Pi equals 
its normalizer, this implies that Out (Pi /(G; V, H^)) is finite, a contradiction. Thus 
G v is elementary, so G v = P\. This proves Assertion 1 in the one-ended case (edge 
stabilizers of T can are finitely generated by Lemma I3.7P . Assertion 2 is also clear since 
Out(Pi ;(G;VM t] )) is virtually Out(Pi; Inc^, wjgj by Proposition Q 

• We now consider the general case, first assuming that G is torsion-free. Let F = G u 
be the vertex stabilizer containing Pi in a Grushko decomposition S relative to V U H 
(see Subsection 12. 5|) . and let V\p,T-L\F be the induced structures (see Definition I2.3|) ; if 
V WH = {Pi}, then F is simply the smallest free factor containing Pi. 

Since F is hyperbolic relative to V\p by Lemma [3.51 and Out(Pi /~(G;V, ~W^')) = 

Out(Pi ;(F;V\f,h\f)) because F is a free factor (or by Remark l2.1ip . the results of the 
previous case apply. The group Pi is a vertex group G v of a splitting Tp of F, which may 
be used to refine 5 to an elementary JSJ decomposition r of G having G v as a vertex 
group (see Subsection 8.1 of [GL09] ) . The families Inc„ and %\g v are the same for Tp and 

r. 

• If G has torsion, we define F = G u and V\p, T~i\F as above, using a Stallings-Dunwoody 
tree S relative to V U H. The proof is technically more complicated because we cannot 
neglect the incident edge groups lnc u . 

All Stallings-Dunwoody trees S have a unique vertex stabilizer G u ^ equal to F, but 
the incident edge groups may vary. This was studied in Section 4 of |GLQ7aj . where we 
defined a "peripheral structure" for F. To state the relevant result, we choose a Stallings- 
Dunwoody tree S for which the valence of u(S) in the quotient graph of groups S/G is 
minimal. Since no edge stabilizer is properly contained in a conjugate, it follows from 
Proposition 4.9 of |GL07aj that the incident structure Inc u (,s) does not depend on the 
choice of such an S (in trees with non-minimal valence, there may be more incident edge 
groups; such a group is contained in a group belonging to Inc u (s)). We fix 5, and from 
now on we write u rather than u(S), so F = G u . 

Any automorphism representing an element of Out(G; V, rt^ 1 ) and leaving Pi invariant 
also leaves F invariant. Since Pi and F are equal to their normalizers, Out(Pi /(G; P, )) 
is the image of the map p : Out(G; P, %(*)) — > Out(Pi), and p factors through p u : 
Out(G;P,^W) -> Out(P). Bv Remark l2TTT1 the image of p u contains OutfP: Incl t} . V\ F , H$>) 

and is contained in Out(P; V\f, ^p)- 

Our choice of S implies that automorphisms in the image of p u preserve Inc u globally. 
Since Inc u consists of finitely many finite subgroups of F (well-defined up to conjugacy), 
the index of Out(P; Incl*'', V\p, H^p) in Out(P; V\p, H^p) is finite. It therefore suffices to 

study the image of q : Out(P; Inc^, V\p, H^,) — > Out(Pi), and to show that it is virtually 
Out(Pi;/CW). 
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The group F = G u is hyperbolic relative to the family V\p (see Lemma I3.5p . and 
one-ended relative to V\p U W\f- Since the image of q is infinite, we have seen that Pi is 
a vertex group G v in the canonical elementary JSJ decomposition r can of F relative to 
V\p U H\f- One obtains an elementary JSJ tree T of G relative to V U H by refining S 
using JSJ decompositions of vertex groups (see Subsection 8.1 of [GL09 ]). so Assertion 1 
is proved. 

Moreover, Out (Pi f(G;V,'H®)) is virtually Out (Pi; /C /(t) ), where K! is the union of 
Inc„ (the incident edge groups of Pi in T can ) and (Inc u U H\f)\p 1 - We now show that 
Kf = K, if we construct T carefully. 

In the construction of T, there is some freedom in the way edges of S containing u are 
attached to T can , and we make sure that, if e is an edge of T \ T can attached to v, then v 
is the only fixed point of G e in T can . 

The family ('Hi [ f)\p 1 is defined viewing F as a vertex group of S, and then Pi as a 
vertex group of T can . Since groups in % are infinite and edge stabilizers of S are finite, 
(7~L\f)\p 1 equals H\p 1 , defined viewing Pi as a vertex group of T. We complete the proof 
by showing that Inct, U (Inc u )ip 1 is the family of incident edge groups in Pi = G v viewed 
as a vertex stabilizer of T. 

There are two types of incident edge groups of G v in T. Those fixing edges in T can are 
precisely those in Inc„. Because of the way we contructed T, those fixing edges in T\T can 
have v as unique fixed point in T can , they are the groups in (Inc u )|p 1 (see Definition 
231). □ 



If G is (absolutely) hyperbolic, and P is a subgroup, then G is hyperbolic relative to 
{P} if (and only if) P is quasiconvex and almost malnormal, see jBow991 Theorem 7.11] 
or |Osi06a| . If so, Theorem 16.21 applies and describes Out(P/G), the automorphisms of 
P which extend to G. 

Corollary 6.3. Let P be a quasiconvex, almost malnormal subgroup of a hyperbolic group 
G, with P^G. 

• If Out(P / G) is infinite, then P is a vertex group in a splitting of G with finitely 
generated edge groups, and Out(P / G) is virtually Out(P;/C^) with /C the family 
of incident edge groups (a finite family of finitely generated subgroups of P). 

• If P is torsion- free, then Out(P/G) has a finite index subgroup with a finite classi- 
fying space. 

Proof The first assertion follows from Theorem 16.21 Being quasiconvex, P is a hyperbolic 
group. It is proved in [GLj that, if P is a torsion-free hyperbolic group and K, is an 
arbitrary family of subgroups, then Out(P; /C^) has a finite index subgroup with a finite 
classifying space. □ 

If G = F n , every finitely generated subgroup is quasiconvex (it is a virtual retract by 
|Hal49j ). so we get: 

Corollary 6.4. If P C F n is finitely generated and malnormal, then Out(P f F n ) is 
virtually Out(P; K,^') for some finite family K. of finitely generated subgroups of P. It has 
a finite index subgroup with a finite classifying space. □ 

This is a partial answer to a question that was asked by D. Calegari. Note that the 
proof uses JSJ decompositions over groups which are not small. 

Example 6.5. Let P C F n be a characteristic subgroup of finite index, with n > 3. Then 
Out(P/G) is not virtually of the form Out(P;/C^) because there exist automorphisms 
of F n with no nontrivial periodic conjugacy class. There are similar exemples with P of 
infinite index. 
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7 Groups with infinitely many automorphisms 



In this section, we characterize those relatively hyperbolic groups whose automorphism 
group is infinite. 

In the first subsection, we point out that determining whether Out(G) is infinite or not 
is relatively easy when G is torsion- free or one-ended. In particular, we give a complete 
answer for toral relatively hyperbolic groups. 

The most interesting case is thus when G has torsion and splits over a finite group. 
For instance, virtually free groups with Out finite were determined by M. Pettet [Pet97] . 
We will give a different characterization (see Example I7.7p . 

If G is hyperbolic relative to V , we will show in Subsection l7.2l that the group 
of automorphisms which act trivially on each parabolic subgroup is infinite if and only if 
G has an elementary splitting relative to V whose group of twists is infinite. 

In Subsection [731 we get a characterization for the full group Out(G; V) being infinite: 
this happens if and only if G has an elementary splitting relative to V whose group of 
twists is infinite, or in which a maximal parabolic subgroup P occurs as a vertex group 
and P has infinitely many outer automorphisms acting trivially on incident edge groups 
(such automorphisms extend to G). 

When G is hyperbolic, we show in Subsection 17.41 that Out(G) being infinite is equiv- 
alent to G having a splitting over a maximal virtually cyclic group with infinite center; 
this is decidable algorithmically. 

7.1 Torsion free groups 

We first note: 

Lemma 7.1. If a torsion-free, finitely generated, group G is a non-trivial free product, 
then Out(Cr) is infinite. 

Proof. Write G = A * B. If a G A is not central, the automorphism of G equal to 
conjugation by a on A and to the identity on B has infinite order in Out(G). Assuming 
that Out(G) is finite, we deduce that Z{A) has finite index in A, so A is abelian because 
LA, A] is finite by a result due to Schur }Rob96t 10.1.4]. Similarly, B is abelian. Moreover, 
Out(A) and Out(i?) are finite, so A = B = Z. This is a contradiction since Out(Z * Z) is 
infinite. □ 

Thus, for torsion-free groups, infiniteness of Out(G) is only interesting for one-ended 
groups. One can get a similar result in a relative setting. 

Proposition 7.2. Let G be a finitely generated, non-cyclic, torsion-free group, and T-L a 
finite collection of finitely generated subgroups. If the Grushko decomposition of G relative 
to H is non-trivial, and not an amalgam G = A±*A2 with A\,Ai abelian, then Out(G; H^) 
is infinite. 

Remark 7.3. If the Grushko decomposition T relative to T~L is G = A\ * Ai with A\,Ai 
abelian, then Out(G; H^) is finite if and only if, for i = 1,2, the subgroup of Ai generated 
by subgroups conjugate to a group in 7~L has finite index. This is because V is Out(G; H^' )- 
invariant by [For02j (its Bass-Serre tree is the unique reduced tree in its deformation space) . 
Twists are trivial because A\ and A2 are abelian, so Out(G;T-L^) is infinite if and only if 
A\ or A2 has infinitely many automorphisms acting trivially on %| J 4 i - 

Proof. Assume that Out(G;7i^) is finite, and let T be a reduced Grushko decomposition 
of G relative to %. We assume that V is non-trivial and we show that it is an amalgam as 
in the proposition. 
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We first note that G cannot split relative to H as an HNN extension G = A*r±\ 
over the trivial group. Indeed, the group of twists of this HNN extension is isomorphic 
to (A x A)/Z(A), with Z(A) embedded diagonally, so contains the infinite group A, a 
contradiction. It follows that T is a tree of groups. 

The proof of Lemma [7.11 shows that, whenever G splits as a free product A * B relative 
to 7i, then A and B are abelian: otherwise the group of twists of the splitting is infinite. 
Since V is reduced, it follows that it is an amalgam G = A\ * A2 with A\, A% abelian: if V 
has more than one edge, collapsing an edge provides a decomposition with a non-abelian 
vertex group. □ 

Let now G be hyperbolic relative to V = {Pi, ■ ■ ■ , P n }, with Pj finitely generated, not 
virtually cyclic. 

If G is one-ended relative to V, one can read infiniteness of Out(G;P) from the JSJ 
decomposition thanks to Theorem 14. 3t Out (Cr;P) is finite if and only if the canonical 
elementary JSJ decomposition relative to V has no flexible QH vertex with infinite mapping 
class group, the parabolic subgroups Pj appearing as vertex stabilizers have Out(P/; Inc^) 
finite, and the group of twists is finite. We may be more specific under additional conditions 
on the parabolic subgroups. 

Proposition 7.4. Let G be a non-abelian toral relatively hyperbolic group. The following 
are equivalent: 

1. Out(G) is finite. 

2. Every non-trivial abelian one-edge splitting of G is an amalgam A *c B with C of 
finite index in A or B. 

3. G has no non-trivial splitting over an abelian subgroup stable under taking roots. 

4- G is freely indecomposable and its canonical abelian JSJ decomposition r can relative 
to non-cyclic abelian subgroups satisfies the following: 

• Tcari consists of a central vertex, possibly connected to terminal vertices carrying 
an abelian group; 

• the central vertex is rigid, or QH with underlying surface £ homeomorphic to 
a pair of pants or a twice punctured projective plane; 

• at each terminal vertex, the incident edge group has finite index in the vertex 
group. 

A subgroup A is stable under taking roots if g S A whenever g n £ A for some n>2. 

The pair of pants and the twice punctured projective plane appear in this statement 
because they are the only compact hyperbolic surfaces with finite mapping class group 
(see the end of Subsection 14. ip . The fundamental group of a pair of pants is rigid. The 
fundamental group of a twice punctured projective plane has two (incompatible) cyclic 
splittings relative to the boundary (it is flexible), but none over a maximal cyclic subgroup. 

Automorphisms of toral relatively hyperbolic groups were considered in [DG08], and 
some of the equivalences in Proposition 17.41 follow from their results (note for instance that 
a splitting as in (3) is an essential splitting in the sense of their Definition 3.30). 

Proof. If G is a free product, (2) and (3) are false, and so is (1) by Lemma 17.11 We 
therefore assume that G is freely indecomposable. 

We prove (1) => (2) by assuming that (2) does not hold, and showing that Out(G) 
is infinite. If G is an HNN extension over an abelian group, or an amalgam with A 
and B non-abelian, the group of twists of the splitting is infinite. If G = A *c B with 
A abelian containing C with infinite index, Out(G) is infinite because A has nontrivial 
automorphisms equal to the identity on C. 
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It is clear that (2) implies (3). To prove that (3) implies (2), first assume that G = 
A*c B with C abelian of infinite index in both A and B. Let C be the set of all roots of 
elements of C, an abelian subgroup containing C with finite index. Since G is elliptic in 
the amalgam, up to exchanging the role of A and B, we can assume that C < A. Then 
G = A *q (B, G) is a decomposition contradicting (3). The case of an HNN extension is 
similar, but we do not need the hypothesis that C has infinite index in A. 

If (4) does not hold, we construct a splitting contradicting (2). If r can has a flexible 
QH vertex, and if the underlying surface is not a twice punctured projective plane, then 
one simply considers the cyclic splitting dual to a 2-sided essential simple closed curve not 
bounding a Mobius band. The other possibility is that r can has a vertex v carrying an 
abelian group such that either v has valence > 2, or v is terminal with the edge group of 
infinite index in G v . One gets the required splitting by collapsing edges of r can . 

We have proved (1) =4> (2) => (4) and (2) 44> (3) . We conclude by deducing from the 
exact sequence of Corollary 14.41 that Out(G) is finite if (4) holds. The groups GL rktUk (Z) 
are trivial because = by the finiteness assumption at terminal vertices. The mapping 
class group of X is finite. Twists are trivial because terminal vertices carry an abelian 
group. □ 

Proposition 7.5. Let G be torsion-free, hyperbolic relative to nilpotent subgroups. As- 
sume that G is not nilpotent. If Out(G) is finite, then G is freely indecomposable and 
its canonical JSJ decomposition r can over nilpotent groups relative to non-cyclic nilpotent 
subgroups consists of a central vertex which is rigid, or QH with underlying surface X 
homeomorphic to a pair of pants or a twice punctured projective plane, possibly connected 
to terminal vertices carrying a nilpotent group. 

Proof. We may assume that no Pi is cyclic, so Out(G) = Out(G;V). As above, G is 
freely indecomposable and there is no QH vertex other than those mentioned. Recall that 
an infinite torsion- free nilpotent group has infinite center. As in the proof of Corollary 
14.41 the group of twists of r can contains the direct product Yli^i^v))^"^ 1 taken over 
vertices carrying a nilpotent group, so is infinite as soon as there is a vertex with valence 
\E V \ > 2. □ 



7.2 Infinity of marked automorphisms 

Theorem 7.6. Let G be hyperbolic relative to V = {P±, . . . , P n } , with each Pi finitely 
generated. Then Out(G;V^) is infinite if and only if there is a splitting of G over finitely 
generated elementary subgroups, relative to V , with an infinite group of twists T (see 
Subsection \2. 6\) . 

More generally, if Q is a finite family of finitely generated subgroups with V C Q, the 
same characterization holds for Out(G; Q^), with a splitting relative to Q. 

By Lemma l2.15l the splittings may be assumed to have only one edge. The proof will 
be given at the end of the subsection. 

Example 7.7. Consider the virtually free group G = D4 *c Dq *c D4, where D n is the 
dihedral group of order n and C has order 2 (note that C is central in D4, but equal to its 
centralizer in Dq). For this two-edge splitting T, and any splitting obtained by collapsing 
an edge, the group of twists is finite. The one-edge splitting A given by the amalgam 
G = Dq *c (-D4 *c however, has a twist of infinite order. The Bass-Serre tree of A 
is the tree of cylinders of the Bass-Serre tree T of V, and Assertion 1 of Proposition I7.1U1 
holds in this case. Compare [Pet97j . 

When G is hyperbolic, the group of twists of the splitting provided by Theorem 17.61 
contains an element of infinite order (see also Theorem l7.14p . The following example shows 
that this does not hold for general relatively hyperbolic groups. 
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Example 7.8. Let G = B\ * B2 be the free product of two infinite torsion groups with 
trivial center. It is hyperbolic relative to V = {Bi,B2}, and Out(G;V^) is infinite. But 
no splitting over elementary subgroups has a twist of infinite order, as we now show. By 
way of contradiction, suppose that some ^c7 o(e) (G e ) contains an element of infinite order. 
The group G e is trivial, or contains a torsion element g 7^ 1, or is isomorphic to Z. It 
cannot be trivial since G D ( e ) would then be a torsion group. The existence of a torsion 
element g also leads to a contradiction since the centralizer of such a g is a torsion group. 
We conclude by observing that G does not split over Z: if it does, an equivariant map 
from the Bass-Serre tree of the amalgam B\ * B2 to that of the splitting maps vertices to 
vertices and must be locally injective, hence globally injective, a contradiction. 

Before proving Theorem 17. 6( we note the following fact, which follows from the pre- 
sentation of T recalled in Subsection [ 



Lemma 7.9. Let G be a relatively hyperbolic group. Let T be a one-edge splitting of G 
over a virtually cyclic group G e with infinite center, with G e not parabolic. Any element 
of infinite order in Z(G e ) defines a twist which has infinite order in Out(G), unless T is 
an amalgam and one of the vertex groups is virtually cyclic with infinite center. □ 



The following result is a key step in the proof of Theorem 17.61 

Proposition 7.10. Let T be a non-trivial tree with edge stabilizers of constant finite 
cardinality k. Let T c be its tree of cylinders for the equality equivalence relation (see 
Subsection\2. 7|). Then at least one of the following holds: 



1. T c is nontrivial and its edge stabilizers are finite; 

2. T has a collapse T' which is nontrivial and has an infinite group of twists T(T'); 

3. T has a collapse T' which is nontrivial and invariant under Out(D(T)). 

T>(T) denotes the deformation space of T over groups of cardinality < k. All reduced 
trees in V(T) have edge stabilizers of order k (see Subsection I2.3() . Also note that T c is 
invariant under Out(£>(T)), and dominated by T, so we get: 

Corollary 7.11. T has a collapse which is nontrivial and has an infinite group of twists, 
or T dominates a nontrivial tree T' with finite edge stabilizers which is invariant under 
Out(£>(T)). □ 



Proof of Proposition \ZW\ We can assume that T is reduced. We first consider the case 
when T c is trivial. Since edges of T belong to the same cylinder if and only if they have 
the same stabilizer, all edges of T have the same stabilizer, a finite normal subgroup A. 

If there is only one orbit of edges, T is the unique reduced tree in V(T) because no 
edge stabilizer may be properly contained in another |Lev05b] . It follows that T' = T is 
invariant under Out(T>(T)). 

Assume that there is more than one orbit of edges. Since A is normal and finite, 
its centralizer in G has finite index, so for any vertex v in an arbitrary collapse T' of 
T (including T itself), and any edge e of T' incident to v, the group Zc v (G e ) is infinite 
as soon as G v is infinite. By Lemma 12.131 if Assertion 2 does not hold, then all vertex 
stabilizers of nontrivial collapses T' are either finite or infinite with infinite center. Since 
T is reduced, this is possible only if T has one orbit of vertices, all vertex stabilizers equal 
to A, and only two orbits of edges (this is respectively because a non-trivial amalgam 
H\ *a H2, an HNN extension Hi* a with Hi ^ A, and a double HNN extension (A* a)* a, 
have finite center). In particular, G/A is free of rank 2. One easily checks that collapsing 
the orbit of any edge gives a tree T" with T(T') infinite, though Lemma 12.131 does not 
apply. This concludes the case when T c is trivial. 
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From now on, we assume that T c is nontrivial and some edge e = (x, Y) of T c has 
infinite stabilizer. View the cylinder Y as a subtree of T containing x, and consider an 
edge e C Y with origin x. Then G Y = N G (G e ) and G £ = G Y n G x = N Gx (G e ). We 
know that Zc x (G e ) is infinite, but we cannot apply Lemma 12.131 since we do not know 
that Z(G X ) is finite. 

Assume for a moment that Y contains edges from at least two G-orbits. Consider T' 
obtained from T by collapsing all edges in the orbit of e, and denote by x' the image of x 
in T' . Since T is reduced, G x $1 G x >. By the assumption on Y, there is an edge e' of T 1 
incident to x' with G e i = G e . Since Zq ,{G e i) is infinite, we are done if Z{G x i) is finite. 
We now show that Z{G X >) being infinite leads to a contradiction. Edge stabilizers of T 
being finite, x is the unique point of T fixed by G £ . Since G £ C G x C G x >, the group 
Z(G x i) normalizes G £ , hence also fixes x, and only x since it is infinite. This implies that 
G x i fixes contradiction to £ G x i. 

Returning to the general case, there is a G-invariant partition of the set of cylinders: 
those for which there is an edge (x, Y) of T c with infinite stabilizer, and the others. Thanks 
to the previous argument, we may assume that all edges contained in a given cylinder of 
the first type belong to the same G-orbit. Let now T' be the tree obtained from T by 
collapsing all edges in cylinders of the second type. It is nontrivial (but T' = T is possible). 
We show that T' does not change if we replace T by another reduced tree T% in D(T). 
This implies that T" is invariant under Out(P(T)). 

One may join T and T\ by slide moves (see Subsection I2.3p . In a slide move, an edge 
e slides over an edge / belonging to a different orbit, with G e C Gf. Here one must have 
G e = Gf, so e and / belong to the same cylinder, necessarily of the second type. The 
slide move does not change T' since the cylinder gets collapsed. □ 



Proof of Theorem 7. 6 , We prove the "only if " direction (the other direction is clear since 
twists act by conjugations on vertex groups). We may assume that all groups in Q are 
infinite. We first suppose that G is one-ended relative to Q. Let T be the canonical 
elementary JSJ tree relative to Q = V U H as in Subsection 13.31 Its edge stabilizers 
are finitely generated by Lemma 13.71 By Theorem 14.61 if Out(G;Qy)) is infinite, then 
either T(T) is infinite and we are done, or T has at least a non-rigid QH vertex v with 
Out(G v ;B v ) infinite. 

The underlying orbifold group vri(S) splits, relative to its boundary subgroups, over a 
maximal virtually cyclic subgroup with infinite center (see |DGllj . Proposition 3.1). This 
induces an elementary splitting of G v which extends to a splitting of G. By Lemma 12.61 
this splitting of G is relative to Q (because the intersection of G v with a conjugate of 
a group in Q projects into a boundary subgroup in 7Ti(E)), and has an infinite group of 
twists by Lemmas 17.91 and 12.141 This proves the theorem if G is one-ended relative to Q. 

In the general case, let k € N be the smallest number such that G splits relative to Q 
over a group of cardinality k. Let T be a reduced JSJ tree relative to Q over subgroups of 
cardinality k (see Subsection 12. 5p . Its deformation space is invariant under Out(G; Q^). 
By Corollary 17.111 either some collapse of T has an infinite group of twists (and we are 
done), or T dominates a nontrivial tree T' with finite edge stabilizers which is invariant 
under Out(G; Qy'). Note that the groups in Q are elliptic in T', since they are elliptic in 
T and T dominates T' . 

We may assume that T(T') is finite. Let A C Out(G; Q (t) ) be the finite index sub- 
group acting trivially on the graph T'/G. By Assertion 1 of Lemma 12.121 there exists a 
vertex group G v of T' such that p v (Aq) C Out(G„) is infinite. In particular, G v is infinite. 

The group G v is hyperbolic relative to the family V\g v ( see Lemma [33]). By Lemma 

I2~10l we have p v (A ) C Out(G„; Q^J. 

If the theorem holds for G v , we get a graph of groups decomposition Tq of G v relative 
to Q\g v having an infinite group of twists. Since T' has finite edge stabilizers, Tq is relative 
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to Inc„ and one may refine T'/G to a graph of groups A by using Tq. By Lemma [2. 141 the 
splitting A has an infinite group of twists. It is relative to Q by Lemma 12.61 

If the theorem does not hold for G v , we repeat the construction. If the process stops 
after finitely many steps, we get a splitting A as in the previous case. If it does not stop, 
we get an infinite sequence of trees Tj relative to Q with finite edge stabilizers, with Tj+i 
strictly dominating Tj. Since G is finitely presented relative to Q, there is a Stallings- 
Dunwoody decomposition relative to Q (see Subsection [23]), and we reach a contradiction 
(see |DD891 p. 130]). □ 

7.3 Infinity of unmarked automorphisms 

Using Theorem l6.2i we now characterize relatively hyperbolic groups for which Out(G; V) 
is infinite. 

We first note the following consequence of Theorem 17.61 

Corollary 7.12. Let G be hyperbolic relative toV = {Pi, ■ ■ ■ , P n }, where each Pi is infinite 
and finitely generated, and let % be a finite family of finitely generated subgroups. 

J/Out(G;P, H®) is infinite, there is an elementary splitting relative to V U H with 
an infinite group of twists, or there is an i such that the natural map Out(G;V,'H^) — > 
Out(Pj) (defined because Pi equals its normalizer) has infinite image. 

Proof. If all maps Out(G; V, M^) — > Out (Pi) have finite image, then the intersection of 
their kernels, namely Out(G; H^), is infinite. We can now apply Theorem 17.61 □ 

Corollary 7.13. Assume furthermore that G is non- elementary (i.e. Pi ^ G). Then 
Out(G; V, H^) is infinite if and only if G has an elementary splitting as a graph of groups 
A relative to V U % such that one of the following holds: 

• the group of twists of A is infinite, 

• or A has a vertex v such that G v = Pi is a maximal parabolic subgroup and Out(GV, Inc« , 1$), ) 
is infinite. 

Proof. As in Theorem 17. 61 the "if" direction is clear, so assume that Out(G;P,^W) is infi- 
nite. By Corollary 17. 121 and up to renumbering, we can assume thatOut(Pi/(G;P,^( t ))) 
is infinite. By Theorem 16.21 Pi is a vertex group in some elementary decomposition of G 
relative toPUU and Out (Pi,; Inc^, ) has finite index in Out (Pi f{G\V,'H^ ) )). In 

particular, Out(Pi;Inc| , , T-L^, ) is infinite. □ 

7.4 Hyperbolic groups 

We apply the results of the previous subsections to the case when G is a hyperbolic group. 
We say that a subgroup of G is -Z max if it is maximal for inclusion among virtually cyclic 
subgroups with infinite center. Note that any virtually cyclic subgroup C with infinite 
center is contained in a unique Z mSiX subgroup C (the pointwise stabilizer of dC). 

Given any splitting of a hyperbolic group over a Z max subgroup C, any central element 
c € C of infinite order defines a twist of infinite order in Out(G). 

Theorem 7.14. If G is hyperbolic, Out(G) is infinite if and only if there is a non-trivial 
splitting of G over a Z m3iX subgroup (such a splitting always has a twist of infinite order). 

If % is a finite family of finitely generated subgroups, Out(G;%^) is infinite if and 
only if there is a non-trivial splitting over a Z mSLX subgroup relative to 7~L. 

It was proved independently by M. Carette [Carllj that Out(G) is infinite if and only 
if G has a splitting over a finite group or a (maybe non maximal) virtually cyclic group 
with infinite center, with a twist of infinite order (sec [Lcv05a, DOll] for the one-ended 
case). 



31 



Proof. The "if" direction is clear, so we assume that Out(G; "H^) is infinite. All splittings 
considered in this proof will be relative to H. 

Theorem 17.61 and Lemma 12.151 say that G has a one-edge splitting over a (possibly 
finite) virtually cyclic group C, whose group of twists is infinite. We assume that this 
splitting is an amalgam G = A *c B; the case of an HNN extension is similar. We first 
explain how to replace this amalgam over C by one over a (possibly non-maximal) virtually 
cyclic subgroup C with infinite center. 

If C is infinite with finite center, its centralizer in G is finite and this forces the group 
of twists to be finite. So assume that C is finite. 

If both Za(C)/Z(A) and Zb{C)/Z{B) are finite, the group of twists is finite, so assume 
for instance that Za{C)/Z{A) is infinite. Note that Z{A) has to be finite, since otherwise 
A would be virtually cyclic, and Za{C)/Z{A) would be finite. Consider an element of 
infinite order t £ Za(C), and perform a fold to get G = A */c,t) (B,t). This is a splitting 
over a virtually cyclic subgroup C with infinite center, and it is relative to H. The twist 
defined by t has infinite order in Out(G) by Lemma 17.91 

Now suppose that an amalgam G = A' *c> B' has an infinite group of twists, with C 
virtually cyclic with infinite center. Then A', B' have finite center. The Z m3iX subgroup C 
containing C is elliptic in the amalgam, and one can perform a fold to get an amalgam 
over C'. This splitting is non-trivial because C is not conjugate to A' or B' since they 
have finite center. The group of twists of the new splitting is clearly infinite. □ 

Theorem 7.15. There is an algorithm which, given a hyperbolic group G, decides whether 
Out(G) is infinite or not. More generally, if H is a finite family of finitely generated 
subgroups, one may decide whether Out(G;7i^) is infinite. 

Proof. We start with the first assertion. 

We first construct an algorithm that stops if and only if Out(G) is finite. By Theorem 
8.1 of [DG11| . one can compute a finite generating set of Out(G). Moreover, one can solve 
the word problem in Out(G) as this amounts to solving (uniformly) the simultaneous 
conjugacy problem in G (see HI KM for a solution). Thus, for each R > 0, one can 
determine the ball Br of radius R in the Cayley graph of Out(G). Checking whether 
Br = Br + \ for some R gives the required algorithm. 

It now suffices to construct an algorithm that stops if Out(G) is infinite. By [DGllt 
Lemma 2.8], one can decide whether a subgroup of G (given by generators) is Z max or not. 
One can therefore enumerate all decompositions of G as an amalgam or HNN extension 
over i? max subgroups. By Corollary 17.141 this provides an algorithm that stops if Out(G) 
is infinite. 

The argument to decide whether Out(G; H^) is infinite is similar. The first algorithm 
is the same since Theorem 8.1 of [DGllj provides generators for Out(G; 7i^). For the 
second algorithm, one has to restrict to splittings relative to T~L, so one needs an algorithm 
that, given a splitting, stops if the splitting is relative to H. This is done by choosing a 
generating set Si for each Hi € H, enumerating all conjugates of Si, and comparing them 
with words written using the generators of a vertex group. □ 

In general, we do not know how to decide whether Out(G;%) is infinite (see Remark 
I4.8p . The following is an answer when G is hyperbolic relative to H. 

Proposition 7.16. There is an algorithm which, given a torsion-free hyperbolic group 
G, a finite family V of finitely generated locally quasiconvex subgroups Pi such that G 
is hyperbolic relative to V , and a finite family H of finitely generated subgroups, decides 
whether Out(G;V,7i^) is infinite. 

Since G is assumed to be hyperbolic relative to V, each P, is quasiconvex in G. In 
particular, Pj is itself a hyperbolic group. Local quasiconvexity of Pj means that its finitely 
generated subgroups are quasiconvex (in Pj, hence also in the hyperbolic group G). 
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Proof. First, using Touikan's algorithm |Touj . one can decide whether G splits as a free 
product relative toVUH. If it does, it is easy to decide whether Out(G; V, T-L^') is infinite 
using Proposition 17.21 and Remark 17.31 

So assume that G is one-ended relative to V U T~L. We may also assume that no Pj is 
cyclic. Local quasiconvexity of Pi implies that Pi has an algorithmically tractable triple 
in the sense of |Touj . since one can decide whether a finite subset S C Pi generates P{ or 
not by checking whether a given generating set of lies in the quasiconvex subgroup (S) 
|Kap96| . 

By |Touj . one can decide whether there exists an elementary splitting of G (viewed as 
a relatively hyperbolic group) relative to V U % with finitely generated edge groups, and 
if so find one. By local quasiconvexity of Pi, edge groups of the splitting are quasiconvex 
in the hyperbolic group G, and so are vertex groups (see Subsection 13. 2|) . 

Iterating this process, one can compute a maximal elementary splitting r of G relative 
to V U T~L (i.e. a splitting that cannot be refined non-trivially into an elementary splitting 
relative to VL)7i). Arguing as in [DG08, Section 6] and jPGll], Lemma 2.34], one may then 
recognize the QH subgroups in T, and find the canonical elementary JSJ decomposition 
of G relative to V U U. 

By Theorem 14. 6| Out(G; V, H^') is infinite if and only if the group of twists T is 
infinite, or there is a vertex v such that Out(G„; \~n.c£\ T~L^} ) is infinite. 

Recall that T is isomorphic to a quotient of Y\ eeE ZG o{e) (G e ) by edge and vertex 
relations. Each group Zc o(e) (G e ) is either trivial or infinite cyclic, and is computable. 
Edge relations and vertex relations are generated by embeddings of groups Z(G e ) and 
Z(G V ) in this product. Since one can compute the corresponding subgroups of the abelian 
group IleG-E ^G r e AG e ), one can decide whether the group of twists is infinite or not. 

To decide whether Out(G v ; Inc^, ) is infinite, we can apply [ DG08| (or more 
explicitly |DG1H Corollary 3.4]), or Theorem 17.151 but we need to determine H\g v (see 
Definition 12 .3p . Given H £ % generated by a finite set S, one can decide whether there is 
g G G such that S 9 C G v in the same way as above because G v is quasiconvex. One can 
similarly decide whether H fixes an edge, which allows to compute T~L\g v - ^ 

8 Fixed subgroups 

In this section, we use JSJ decompositions to study fixed subgroups of automorphisms. 
This is inspired by arguments due to Sela [Sel96j . The proof of the Scott conjecture 
(Theorem I8.1|) given below is not really new, but using the relative JSJ decomposition 
makes the argument more direct. Using Theorem 18.21 we will prove in [GLJ that, given 
a toral relatively hyperbolic group G, there are only finitely many possibilities for fixed 
subgroups of automorphisms of G, up to isomorphism. This was proved by Shor [Sho99] 
for G torsion-free hyperbolic. 

Theorem 8.1 ([BH92J). Let a be an automorphism of a free group F n . Its fixed subgroup 
Fix a has rank at most n. 

Proof. The smallest free factor containing Fix a is a- invariant, so we may assume that F n 
is one-ended (freely indecomposable) relative to Fix a. We also assume that Fix a is not 
cyclic. 

Let T be the canonical cyclic JSJ tree relative to Fix a (see Subsection [33]), and let G v 
be the vertex stabilizer containing Fix a. It is a-invariant because T is invariant and v is 
the only vertex fixed by Fix a, and abelianizing shows that it has rank < n. By Remark 12 .91 
it cannot be flexible QH because Fix a is not cyclic, so it is rigid. By standard arguments 
due to Paulin and Rips, a has finite order in Out(G v ): otherwise, applying Theorem 13.91 
with V consisting of incident edge groups and T~i consisting of Fix a (which is finitely 
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generated) yields a cyclic splitting of G v which contradicts rigidity. By Dyer-Scott |DS75j . 
Fix a is a free factor of G v so has rank < n. 

If we do not wish to use Gersten's result that Fix a is finitely generated [Ger87j , we 
argue by contradiction as follows. Let H be a finitely generated free factor of Fix a of 
rank > n. We claim that F n is one-ended relative to H (see [Perllj and Lemma 7.6 of 
|GL10| for more general statements). Otherwise, let H be the smallest free factor of F n 
containing H. Then H is a-invariant, and Fix a PI H has rank at most n — 1 (assuming 
that the theorem holds in H by induction on n) , a contradiction since Fix a Pi H retracts 
onto H. 

Define G v as above, using the cyclic JSJ splitting of F n relative to H. The fixed 
subgroup of ot\G v is a subgroup of Fix a which has rank < n and contains H. This is a 
contradiction since H is a retract of Fix a. □ 

This proof uses [DS75J, which is specific to free groups. Applying the same argument 
to (relatively) hyperbolic groups only yields: 

Theorem 8.2. Let G be hyperbolic relative to a finite family V of slender subgroups. 
Consider a G Aut(G;"P) such that Fix a is not elementary (i.e. not virtually cyclic or 
parabolic). Then Fix a is contained in an a-invariant vertex group G v of a splitting of G 
over elementary subgroups relative to V , and ol\q v has finite order in Out(G„). 

Proof. The proof is similar to the one above. Note that Fix a is finitely generated by 
[HrulOl Cor. 9.2] because it is relatively quasiconvex |MUj and groups in V are slender. 
First assume that G is one-ended relative to V U {Fix a}. Let T can be the canonical 
elementary JSJ decomposition of G relative to V U {Fix a}. Let v be the unique vertex 
of T caxi fixed by Fix a. As above, G v is a-invariant; it cannot be QH because it contains 
the universally elliptic subgroup Fix a which is not virtually cyclic, so G v is rigid: it has 
no elementary splitting relative to Inc„ U V\q v U {Fix a}. By Lemma 13.81 G v is hyperbolic 

relative to Inct, U V\q v . By Theorem 13.91 the group Out(G v ; Inc„, V\g v , {Fix a} ) is finite. 
It contains the class of cx\g v by Lemma \2.1U\ so ch\q v has finite order in Out(G„). 

If G is not relatively one-ended, we consider a reduced Stallings-Dunwoody tree S 
relative to VU {Fix a} (see Subsection I2.5p . Since Fix a is infinite, it fixes a unique vertex 
u € S. The deformation space of S is a-invariant, so a{G u ) fixes a vertex v! £ S. Since 
Fix a C a(G u ) fixes only u, we have u' = u and a(G u ) = G u . We now apply the previous 
analysis to the restriction of a to G u , which is hyperbolic relative to V\g u by Lemma 13.51 
We get a splitting A of G u relative to V\g u , and we obtain the desired splitting of G by 
refining S/G using A (see Lemma l2.6p . □ 

9 Rigid groups have finitely many automorphisms 

The goal of this section is to prove Theorem 13.91 Let us first recall its statement. 

Theorem 3.9. Let G be hyperbolic relative to finitely generated subgroups V = {Pi, . . . , P n }, 
with P{ G. Let TL = {H\, . . . , H q } be another family of finitely generated subgroups. If 
Out(G;V,'H^) is infinite, then G splits over an elementary subgroup relative to V U 7i. 

As mentioned earlier, the proof uses M-trees. All actions on M-trees considered here 
are by isometries. An arc is a subset isometric to an interval [a, b] C K with a ^ b. As 
in the simplicial case, an action on an M-tree T is relative to subgroups H{ if each Hi is 
elliptic (fixes a point) in T. 

Because the parabolic groups are not assumed to be slender, we will need to analyze 
actions on M-trees which are not quite stable. 
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9.1 Constructing an R-tree 

Theorem 9.1 ( |BS08| ). Let G,V,H be as in Theorem\3M If ' 0\\t{G;V ',U i ^) is infinite, 
then G has a non-trivial action on an M-tree T relative to V U % such that arc stabilizers 
are elementary. 

The proof is essentially in [BS08| . noting that a locally elementary subgroup is ele- 
mentary by Lemma 13.11 We also add the remark that the groups Pi , Hj are elliptic in 
T. 

Proof. Let tpk be automorphisms representing distinct elements of Out(G; V, rl^). Let X 
be a J- hyperbolic space on which G acts as in Subsection 13. II Consider a finite generating 
set S of G, and the minimal displacement dk = inf xe x vaax se s dx(x, ifk(s).x). Choose a 
point x k € X where max seS d x (xk, ipk(s).x k ) < d k + \ 

Using the Bestvina-Paulin method, it is shown in |BS08j that d k goes to infinity, the 
rescaled pointed metric spaces X k = (-^X,Xk) converge to an M-tree T (after taking a 
subsequence) , and the action of G on X^ twisted by ip^ converges to a non-trivial isometric 
action of G on T with locally elementary (hence elementary) arc stabilizers. 

We now prove that the action is relative to V Url. Since groups in V U Ti are finitely 
generated, it suffices to show that any element g belonging to Pi or Hj is elliptic in T. 

Suppose g acts hyperbolically in T. Then there exists a £ T such that dT(a,g 2 a) = 
2dT(a,ga) > 0. If is an approximation point of a in X^ = ^-X, then 

dx(ak,<Pk(g 2 )ak) ~ d x (ak, ( Pk(g)ak) 
dk 

converges to dT(a,g 2 a) — dT(a,ga) = dx{a,ga) > 0, so for k large enough 

d x (ak,(pk(g 2 )ak) ~ dx(a k ,fk(g)ak) > 25 + -^-d T (a,ga). 

Lemme 9.2.2 of [CDP90J implies that (pk(g) acts loxodromically on X, with translation 
length going to infinity since d^ — > oo. This is a contradiction if g £ Pi, since every (fk(g) 
is parabolic in this case. If g € Hj, all elements <pk(g) are conjugate so have the same 
translation length in X, also a contradiction. □ 

Remark 9.2. One can show that a group H € H is elliptic in T, even if it is not assumed to 
be finitely generated. We know that every h £ H is elliptic. If H is not elliptic, it fixes an 
end of T, so every finitely generated subgroup of H fixes a ray. This implies that finitely 
generated subgroups of H are parabolic, so H is parabolic and therefore elliptic in T. 
On the other hand, Theorem 19.41 below requires finite generation. 

Remark 9.3. The hypothesis that automorphisms act trivially on Hj may be weakened. 
It is sufficient to assume that their growth under iteration is slower on Hj than on G. 

9.2 Hypostability 

To deduce a splitting as in Theorem 13.91 from the action on the R-tree of Theorem 19. 1\ we 
will generalize the following basic fact (see Theorem [9J5J) : 

Theorem 9.4 ([BF95, Thm 9.6]). Let G be a finitely presented group, and let Q be a 
finite family of finitely generated subgroups. Assume that G has a non-trivial stable action 
on an M-tree T relative to Q. Then G splits relative to Q over a group K which is an 
extension 1— > A — > K ^ ^ ^ 1, where A fixes an arc of T and k > 0. 

Recall that an arc J is stable if any subarc of J has the same stabilizer as J. An action 
is stable if every arc I contains a stable subarc J. 
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Corollary 9.5. Theorem \3.9\ holds if every Pi is slender and G is finitely presented. 

Proof. If every Pj is slender, the action on the M-tree T provided by Theorem 19. II is stable 
because elementary subgroups satisfy the ascending chain condition. If furthermore G is 
finitely presented, Theorem 19.41 (applied with Q = V U H) gives a splitting that satisfies 
the conclusion of Theorem 13.91 since K is elementary if A is. □ 

In general, however, G is only finitely presented relative to V, and the action on T 
only satisfies a weaker property than stability, which we call hypostability (see |KaplO| 
for a different property called semistability). 

Definition 9.6. Let G be a group acting on an M-tree T. The action is hypostable if, for 
each arc I CT, there exists a subarc J C I satisfying the following hypostability condition: 
if g G G acts hyperbolically in T and gJCiJ is an arc, then Stab J = Stab^J) (equivalently, 
g normalizes Stab J,). 

Hypostability is weaker than stability, because any stable arc J satisfies the hyposta- 
bility condition: if gj n J is an arc, (Stab( J), Stab^J)} is contained in the stabilizer of 
gj PI J, which coincides with Stab(J) and Stab(gJ) by stability of J and gJ. 

Lemma 9.7. Let G be hyperbolic relative to finitely generated subgroups V = {P\, . . . ,P n }. 
Any action of G on an M-tree T relative to V with elementary arc stabilizers is hypostable. 

Proof. Let C be such that any elementary subgroup H of G of cardinality > C is contained 
in a unique maximal elementary subgroup E(H) (see Lemma l3.ip . Let / C T be an arc. 
If the stabilizer of every subarc has cardinality at most C, then a subarc J C I whose 
stabilizer has the greatest cardinality is stable and we are done. 

Otherwise, consider J C I whose stabilizer H = Stab(J) has cardinality > C. The 
stabilizer of every subarc of J is elementary, so is contained in E(H). If subgroups of 
E(H) satisfy the ascending chain condition, in particular if E(H) is virtually cyclic, then 
J contains a stable subarc. Thus we can assume that E(H) is parabolic. 

We prove hypostability by showing that any g such that gJdJ contains an arc is elliptic 
in T. Indeed, (H,H 9 ) fixes an arc in T, so is elementary. It follows that {H,H 9 ) C E(H), 
so E(H) = E(H3) = E(H)9. Since E(H) is its own normalizer, we get g G E(H). But T 
is relative to V, so g is elliptic. □ 

Example 9.8. We sketch the construction of an action as in Lemma [9.71 which is not stable. 
Let G be the free product G = P * Z, with P a (non-slender) finitely generated group 
containing a copy of the free abelian group on a countable basis Z™. Note that G is 
hyperbolic relative to {P, Z}. Informally, identifying the edge of the free product with 
[0, 1], one can produce an R-tree from the Bass-Serre tree of this splitting by folding the 
group ^°'q^ n ^ on a length | for all < | < 1. The stabilizer of an arc [a, b] C [0, 1] is 
then z([° ,fe l n< ®. This action is hypostable but unstable. 

Theorem 9.9. Theorem \9.4\ holds if the action on the M-tree is only assumed to be hy- 
postable, and the group G is only assumed to be finitely presented relative to Q. 

The proof will be given in the next subsection. The following corollary is an immediate 
consequence of Lemma 19.71 and Theorem 19.91 

Corollary 9.10. Let G be a relatively hyperbolic group, with V,H as in Theorem \3. 91 If 
G acts non-trivially on an M-tree T relative to VUTi with elementary arc stabilizers, then 
G splits over an elementary subgroup relative to V U %. □ 

Theorem 13.91 follows immediately from this corollary, using the M-tree provided by 
Theorem 19.11 A refinement of Corollary 19.101 will be given in Subsection 19.41 
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Remark 9.11. Let G and T be as in Theorem 19.41 If T is not a line, one can get a splitting 
over a group K which is an extension of Z or Z/2Z by a group A fixing an arc in T (see 
[BF95]). One can also approximate T (in the equivariant Gromov topology) by simplicial 
trees with controlled edge stabilizers, as in [Gui98j. The same facts are true under the 
assumptions of Theorem 19.91 

9 . 3 Proof of Theorem MM 

Recall that a subtree Y C T is indecomposable |Gui08j if, given arcs I, L C Y, there exist 
9li ■ ■ ■ ,9n G G such that L C g\I U • • • U g n I, and every gil Pi gi+\I is an arc. We call 
g%,...,g n an I -covering of L. 

Lemma 9.12. Assume that Y C T is an indecomposable subtree. Given two arcs I,L cY 
with I C L, there exists an I -covering gx, . . . ,g r of L such that g\ = 1 and every gig~\ is 
hyperbolic in T. 

Proof. Given any /-covering of L, there exists i such that I n gil is an arc, and therefore 
1, gi,gi-i, . . . , g\, g2, ■ ■ ■ , g n is an /-covering starting with 1. From now on, we only consider 
coverings starting with 1. The interval covered will always be L. 

We fix an orientation of /. It induces an orientation of gl for any g € G. If / n gl 
is an arc, the orientations of I and gl may agree or disagree on this arc. We first claim 
that there exists an /-covering 1 = a%, . . . , a p of L such that, for each i, the orientation 
of ail agrees with that of a^il on their intersection (we say that such an /-covering is 
orientation-preserving) . 

If not, we can find arcs gl, g'l whose intersection is an arc on which the orientations 
disagree. Define go = g'~ 1 g and J = I n gol; the orientations of / and g$I disagree on 
J. Now consider a J-covering 1 = b\, . . . , b p of L. It is also an /-covering of L. Since 
J = / fl gol, we get another /-covering of L if we replace some of the b^s by hgo. Starting 
with a\ = b\ = 1, we then define Oj inductively as either b{ or bigo, making sure that 
orientations agree. This proves the claim. 

Next note that there exists a hyperbolic element h £ G mapping an arc J' C / to 
a different arc h(J') C / in an orientation-preserving way. To see this, first choose h\ 
mapping an arc J\ C / to a disjoint arc J2 C /. If orientation is reversed, choose /12 
mapping an arc J3 C J2 to an arc J4 C / different from J± and J3. Then take h equal to 
h2 or h%h\. 

We can now conclude. Let 1 = a%, . . . , a r be an orientation-preserving /'-covering of 
/. Since J' C / fl /i^ 1 /, we get another orientation-preserving /-covering if we replace 
some of the a^s by aj/i -1 . If aia^\ is not hyperbolic, it is the identity on aj_i J' fl ajj'. 
We therefore get the required /-covering of L by defining g, L inductively as ai or Oj/i -1 so 
that g%g~\ is not the identity on <2j_i J' fl a^J' '. □ 

Corollary 9.13. Let T be hypostable, and letY dT be an indecomposable subtree. Any 
element g € G fixing an arc in Y fixes the whole of Y . In particular, any arc in Y is 
stable. 

Proof. Assume that g fixes an arc / C Y . Given x G Y, we aim to prove that g fixes 
x. After making / smaller, we can assume that there is an arc L containing x and /. 
Definition 19.61 provides a subarc J C / satisfying the hypostability condition. Consider 
a /-covering 1 = gi, . . . ,g r of L as in Lemma [9.121 Since gi+ig^ 1 , hence also g^ l gi+i, 
is hyperbolic, hypostability of J implies that all arcs giJ have the same stabilizer. The 
element g fixes g\ J = J, so it fixes every <?jj and therefore L. In particular, g fixes x. □ 

Proof of Theorem \9.9\ We explain how to adapt the arguments in ^BF95 PGui98| . 

Let Q = {Qi, . . . , Qq}- Let (Si \ IZi) be a presentation of Qi, with Si a finite generating 
set and Hi a possibly infinite set of relators. Let {S \ 1Z) be a presentation of G such that 
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S is a finite generating set of G containing each Si, and 1Z is the union of TZ% U • • ■ U TZ q 
with finitely many additional relators. 

Consider a finite subtree K C T, i.e. the convex hull of finitely many points. We 
explain how to choose K large enough so as to yield a resolution of T. 

For each s £ S, we consider K s = K PI s -1 iT and the restriction (p s : K s — > sK s of s 
(we may assume that no K s is empty). We then define the suspension £ as the foliated 
2-complex obtained by gluing foliated bands K s x [0, 1] to K, where we glue (x, 0) to x 
and (x, 1) to ip s (x). Note that 7Ti(£) is naturally identified with the free group on S. 

Next, we need all relators of 1Z to be represented by loops contained in leaves of S. Since 
each Qi fixes a point pi in T, and S contains Si, requiring that K contains p\, . . . ,p q takes 
care of 1Z\ U • • • L)lZ q . There remain finitely many other relators, and, as in [BF95, Gui98j, 
one can choose K so that they also are represented by loops contained in leaves. 

The complex £ provides a resolution of T in the sense of Definition 2.2 of [Gui98j (as 
pointed out in |Gui98| . the set C of curves contained in leaves mentioned in Definition 

2.2 is not assumed to be finite). Obtaining a resolution is the only place where finite 
presentation is used in |Gui98j . 

As for stability, it is used only in Proposition 4.3 of [Gui98j to prove that, if an element 
fixes an arc in the subtree Tr v C T corresponding to a minimal component of S, then it 
fixes the whole of Tp v . By |Gui08, Proposition 1.25], the geometric R-tree dual to a 
minimal component of £ is indecomposable, and by Lemma 1.19(1) of [Gui08j its image 
Tr v C T is an indecomposable subtree of T. Corollary 19.131 then replaces Proposition 

4.3 of |Gui98| under our hypostability assumption. The rest of the argument of |Gui98| 
applies without modification. □ 



9.4 2 max splittings 

Say that a subgroup of a relatively hyperbolic group is Z max if it is maximal for inclusion 
among non-parabolic virtually cyclic subgroups with infinite center. 

Theorem 9.14. Let G be hyperbolic relative to V = {Pi, ■ ■ ■ ,P n }, with Pi finitely gener- 
ated. Let % = {H\, . . . Hq} be a (possibly empty) family of finitely generated subgroups. 
Assume that G acts non-trivially on an M-tree T relative to VWH, and that arc stabilizers 
are either finite, parabolic or Z mSkX . 

Then G splits relative to V U % over a finite, parabolic or i? max subgroup. 

Corollary 19.101 provides a splitting over an elementary group A. Here we assume that 
every loxodromic arc stabilizer of T is 2 m3iX , and we claim that the same is true for A: if 
it is loxodromic, then it is -Z max . 

Proof. • Assume first that the foliated 2-complex £ constructed in the proof of Theorem 
19.91 has a minimal component £„ . Let G v be the image of its fundamental group in G, and 
let Tq v C T be the corresponding subtree of T. In particular, G v is not elliptic in T. By 
[BF95, Theorem 5.13] or |Gui981 Theorem 3.1], G v is a vertex group in a decomposition 
of G as a graph of groups T relative to VWH. All arcs in Tq v have the same stabilizer F, 
a normal subgroup of G v . 

We claim that F is finite. Otherwise, there are two cases. If F is non-parabolic, hence 
virtually cyclic, it has finite index in its normalizer and therefore in G v , so G v is elliptic, a 
contradiction. If F is infinite and contained in a maximal parabolic group P, then almost 
malnormality of P implies that the normalizer of F is contained in P, so G v C P. Since 
P is elliptic in T, this is also a contradiction. Thus F is finite. 

We now distinguish several cases, depending on the nature of the minimal component 
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First, ~E V cannot be a homogeneous (axial, toral) component since G v would then 
be virtually Z k for some k > 2 ( |BF951 Theorem 9.4(2)] or |Gui98j section 5.1]), hence 
parabolic, contradicting ellipticity of parabolic groups in T. 

If £„ is an exotic (Levitt, thin) minimal component, one obtains a splitting of G over 
F, and we are done ( |Gui98l Proposition 7.2], [BF951 Theorem 9.4(3)]). 

If £„ is a surface (IET) component, then by [BF95, Theorem 9.4(1)] or |Grui98|. section 
8], after performing some moves, one can assume that X„ is a surface with boundary, 
and G v /F is the fundamental group of a 2-orbifold with conical singularities supporting a 
measured foliation with dense leaves. Moreover, G v is a QH vertex group (with fiber F) 

of r. 

Let A C G v be the preimage of the fundamental group of an essential two-sided simple 
closed curve not bounding a Mobius band, and not boundary parallel. Then G splits over 
A relative toVUH. We check that A is 2 max . Clearly, A is virtually cyclic with infinite 
center, and is maximal among virtually cyclic subgroups of G v . Since G v is QH and A is 
not conjugate into a boundary subgroup, it easily follows that A is Z max in G. 

• The remaining case is when £ has no minimal component. In this case, all leaves of 
£ are finite, and the dual tree Ts is simplicial. Its edge stabilizers fix an arc in T, so we 
are done if one of these edge stabilizers is finite or parabolic. Otherwise, arc stabilizers of 
Ts are virtually cyclic with infinite center but may fail to be i? m ax- If this happens, we 
have to enlarge the finite tree K used to construct £. 

By [LP97j, we can find an exhaustion of T by an increasing sequence of finite subtrees 
Kk such that the corresponding dual trees T^ k strongly converge to T. We refer to [LP97] 
for the definition of strong convergence; we will only use the fact that, if A is a finitely 
generated group fixing an arc in T, then A fixes an edge in Tj^ k for large enough k. 

We can assume that all dual trees T% k are simplicial, and that their edge stabilizers 
are infinite and not parabolic. Let Aq be an edge stabilizer of Ts . Then Aq fixes an arc 
/ in T. By the hypothesis on arc stabilizers of T, the stabilizer of J is a i? max subgroup 
A D Aq, which fixes an edge e of T% k for k large enough. Since G e contains A and fixes 
an arc in T, it is equal to A, so T^ k provides the desired splitting. □ 

A similar proof yields the following results. 

Theorem 9.15. Let G be hyperbolic relative to V = {P±, . . . ,P n }, with Pi slender, and 
let H = {H\, . . . Hq} be a family of finitely generated subgroups. Assume that G acts 
non-trivially on an M-tree T relative to V WH, with elementary arc stabilizers. 

Then G splits relative to V WH over cl -2 m ax subgroup or over the stabilizer of an arc 
ofT. □ 

Corollary 9.16. Let G be a toral relatively hyperbolic group. Consider a non-trivial action 
of G on an R-tree relative to non-cyclic abelian subgroups. If arc stabilizers are abelian 
and stable under taking roots, then G splits (relative to non-cyclic abelian subgroups) over 
an abelian subgroup stable under taking roots. □ 
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